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Preface 


My  thesis  deals  with  topics  In  uncertainty  reasoning,  which  is  appropriate  since  for 
most  of  the  duration  I  was  uncertain  about  just  what  my  topic  was.  I  spent  many  days 
wondering  just  what  I  was  supposedly  doing.  Although  it  could  hardly  be  said  that  I 
was  apoplectic  with  apprehension,  I  was  alternately  concerned  about,  and  oblivious  to  my 
plight.  Practicing  avoidance  and  denial  became  a  hobby,  but  unfortunately,  as  fate  would 
have  It,  the  task  before  me  never  unilaterally  abated.  Many  times  the  future  of  this  thesis 
seemed  so  very  uncertain  (at  least  to  mo).  However,  in  the  end  the  work  was  done,  my 
mission  completed. 

My  advisor,  Maj  Bruce  W.  Morlau,  told  me  that  he  knew  where  I  was  going  (e,\ls> 
tontially,  that  Is).  To  him,  I  give  thanks;  the  type  of  thanks  one  gives  a  dentist  after  an 
unwanted  root  canal.  He  gave  me  encouragement  and,  at  times,  fear,  both  of  which  proved 
to  be  motivational, 

In  retrospect,  all  that  has  passed  has  changed  me,  but  all  I  really  know  Is  that  I 
feel  older  now,  The  people  around  me,  my  classmates  and  friends,  I  am  beholden  too.  I 
thank  my  advisor,  Maj  Bruce  W.  Morlan,  for  those  interesting,  frustrating,  e.^a8pernting 
debates  which  always  strayed  from  their  original  convoluted  course.  I  thank  my  reader,  Ll 
Col  Skip  Valusek,  for  questioning  the  things  I  took  for  granted,  for  catching  the  abundant 
small  errors,  and  most  of  all,  for  not  keelhauling  me  for  my  lack  of  communication.  Fm-  all 
those  who  supported  me  in  this  endeavor,  I  bubble  with  gratitude,  You  lielpod  mo  by  just 
laughing  with  mo  and,  at  timoii,  at  me.  I  like  most  of  you  .and  will  miss  .some  of  you. 


Scott  10,  Deakln 
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Abstract 

Incorporating  techniques  for  coping  with  uncertainty  in  the  decision  support  systems 
has  proven  to  be  a  fertile  environment  for  creative  ideas.  Representations  of  uncertainty 
abound  and  no  representation  can  be  said  to  be  inherently  incorrect.  From  a  thoorotical 
standpoint,  a  viable  solution  must  be  coherent  and  logically  consistent.  Probability  theory 
demonstrates  these  characteristics  while,  as  of  yet,  other  methods  do  not. 

The  purpose  of  this  study  was  to  investigate  specific  topics  in  uncertainty  reasoning; 
1)  Probability  ratio  graphs  as  a  representation  of  the  probability  model;  2)  Dealing  with 
missing  information  when  system  parameters  are  left  unspecified;  3)  Investigating  the 
difference  between  probabilistic  and  causal  independence;  and,  4)  Charactoriiilng  secondary 
uncertainty  as  spurious  evidence  and  Including  it  in  the  Inference  process. 

It  was  shown  that  probability  ratio  graphs  arc  a  viable  motliod  for  representing 
uncertainty,  and  a  method  for  representing  independence  with  probability  ratio  gra])l>s  is 
presented.  Assuming  probabilistic  independence  for  missing  information  is  shown  to  l\ave 
intuitive  and  computational  benefits;  also  shown  is  that  whore  secondary  uncertainty  is 
included  in  the  inference  process  has  great  Impact  on  the  computational  complexity  of  an 
inference  process. 


vill 


} 


An  Investigation  and  Interpretation 
of 

Selected  Topics  in  Uncertainty  Reasoning 


I.  Organization 

I  was  to  learn  early  in  life  that  we  tend  to  meet  any  new  situation  by  reorga¬ 
nizing...  and  a  wonderful  method  it  can  be  for  creating  the  illusion  of  progress 
while  producing  inefficiency  and  demoralization. 

-Pctronlus  (died  A.D.  66) 

The  need  for  access  to  expert  opinion  and  analysis  when  qualified  experts  are  a 
scarce  commodity  is  driving  the  development  of  artificial  experts.  These  artificial  exports 
are  known  as  expert  systems,  and  through  their  use,  expert  opinion  and  analysis  i.s  ac¬ 
cumulating,  and  becoming  transportable  and  standardized.  If  these  systems  are  to  bo 
useful  they  must  address  and  meet  certain  requirements.  Some  Important  requiromonis 
are  the  capability  for  handling  large  quantities  of  information,  dealing  with  uncertainly, 
and  heuristic  control  of  the  search  space.  Computer  based  expert  systems  provide  tlio 
important  capability  of  rapidly  handling  large  quantities  of  data.  However,  combining  the 
computer’s  capabilities  with  experts’  experience  and  heuristic  rca, soiling  is  proving  to  lie  a 
formidable  task  subject  to  much  debate. 

Expert  systems  are  complex  automated  checklists.  Though  the  term  expert  system 
sprang  from  the  field  of  artificial  intelligence  (AI),  they  have  existed  in  principle  umlor 
other  names  and  in  other  forms.  Artificial  intelligence  provided  an  alternative  to  classical 
operations  research  (OR)  in  solving  complex  problems;  OR  applies  optinii/.ation  tecliniiines 
to  complex  problems  expressed  in  real  numbers,  whereas,  AI  applies  licuristic  scarcli  to 
complex  problems  that  defy  classical  OR  techniques.  Most  complex  probloni.s,  especially 
those  expert  systems  face,  would  benefit  from  a  combination  of  both  OR  and  A1  techni(ines 
(17:11):  OR  can  provide  probability  and  decision  theoretic  tccliniques  for  dealing  with 
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uncertainty,  and  AI  can  provide  heuristic  control  for  managing  the  exponential  explosion 
to  which  probabilistic  systems  are  vulnerable. 

Researchers  have  recognized  the  usefulness  of  a  symbiosis  between  OR  and  Al.  They 
are  incorporating  probability  and  decision  theory  Into  the  development  of  expert  syslGins 
(Kalagnanam  and  Henrion;1988,  Breese  and  Fehling!l988,  Heckerman;1988).  Along  these 
lines,  Hollenga  codified  a  method  for  developing  expert  systems  that  utilizes  the  synergistic 
effect  of  combining  OR  and  AI.  In  his  paper  “A  Decision-Theoretic  Model  for  Constructing 
Expert  Systems,”  he  outlines  a  five  step  process  that  incorporates  Bayesian  reasoning  in 
the  development  of  the  export  system  rule  base; 

1.  A  group  of  decision  makers  decides  on  strategy  Implementation. 

2.  The  output  of  the  first  step  is  then  translated  into  a  decision  analytic  framework 
where  hypotheses,  evidences,  strategies,  probabilities,  and  utilities  are  Identified. 

3.  From  the  second  step,  probability  thresholds  arc  Identified.  These  thresholds  Indicate 
the  strategy  with  highest  utility. 

4.  Executable  rules  are  then  generated  such  that  only  the  evidence  is  needed  to  deter¬ 
mine  an  action. 

5.  The  last  step  is  encoding  the  executable  rules  Into  a  format  that  an  expert  syslcin 
can  manipulate  (813-8). 

Ilolienga’s  method  involves  using  decision  analysis  to  generate  the  export  .system  rule 
base.  In  effect,  the  decision-analytic  framework  becomes  the  export  for  rule  dovolopiiu'iit 
(8:8). 


1.1  Thesis  Re.search 

Ilollenga’s  process  is  a  cnucoptual  model  which  needs  an  architecture  for  roseiu'c!i 
into  Its  practical  feasibility.  A  research  tool  that  enables  research  Into  the  capahilily  of  the 
aforementioned  process  goes  far  In  supporting  investigations  Into  the  Implications  of  the 
proposed  method. 

Morlan  proposes  probability  ratio  graphs  as  a  molhtul  for  manipulating  relational 
Information  (13).  Represented  In  this  way,  decisions  and  Inforences  depend  on  the  relative 
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weight  of  the  propositions.  The  odds-ratio  structure  presents  a  graphically  appealing 
method  for  user  comprehension  where  conditional  relationships  are  visually  evident. 

This  thesis  used  Hollenga's  proposed  five  step  method  as  a  starting  point  for  research 
into  uncertainty  reasoning.  The  development  of  a  research  tool  for  Investigation  into  IIol- 
lenga’s  proposed  five  step  method  (specifically,  step  three)  provided  a  means  for  further 
refining  Morlan's  concept  of  probability  ratio  graphs  and  generating  questions  about  un¬ 
certainty  reasoning.  Several  Interesting  topics  of  concern  arose:  representing  independence 
in  probability  ratio  graphs,  generating  missing  evidence,  the  meaning  of  independence,  and 
secondary  uncertainty  and  spurious  events. 

l.i  Rtatarch  Objective 

The  objective  of  this  research  was  to  investigate  questions  about  uncertainty  reason¬ 
ing  and  further  refine  the  probability  ratio  graph  concept.  The  methodology  centered  on 
developing  a  PC-based  research  tool  for  investigating  the  nuances  of  Hollcnga’s  five  step 
method  for  isolating  questions  about  uncertainty  reasoning  and  applying  probability  ratio 
graphs.  The  resulting  computer  program  Is  a  secondary  deliverable;  it  is  conceptually  con¬ 
cerned  with  the  propagation  and  visual  representation  of  probability  and  utility  relational 
information  using  an  odds-ratio  approach. 

1.3  Research  topics 

During  this  research  several  topics  arose  that  wore  of  some  interest.  These  topics 
spawned  questions  of  interpretation  where  the  answers  were  Ill-defined  and  not.  Inimccli- 
ately  obvious,  The  design  heuristics  of  decision  support  systems  depend  in  part  on  the 
interpretations  that  result  from  these  considerations. 

•  When  system  parameters  are  unspecified,  how  should  a  diagnostic  system  deal  with 
the  missing  information? 

•  Under  the  common  assumption  of  disjoint  hypotheses,  what  does  hypothesis-evidence 
independence  mean? 

•  What  is  the  meaning  of  spurious  evidence,  and  how  does  it  affect  the  diagnostic 
system? 
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1,4  Scope 


There  are  many  proposed  methods  for  representing  and  coping  with  uncertainty 
(certainty  factors,  fuzzy  sets,  Dempster-Sheafer,  Bayesian  Inference);  each  method  has 
good  and  bad  facets.  As  in  any  situation,  the  problem  at  hand  drives  the  choice  of  the 
tool.  Misapplication  of  a  tool  can  have  potentially  damaging  effects  which  cannot  always 
be  predicted. 

This  research  uses  probabilities  for  representing  uncertainty  due  to  demonstrated  ad¬ 
vantages;  it  provides  well-known  ways  of  incorporating  empirical  data,  has  well  developed 
methods  for  evaluating  Judged  or  computed  probabilities  by  comparison  with  empirical 
frequencies,  and  has  been  shown  that  for  any  reasonable  scoring  rule,  any  scalar  measure 
of  uncertainty  Is  either  worse  than  probability  or  Is  equivalent  to  it  (7i2). 

1,5  Summary 

Growing  Interest  in  expert  systems,  speciflcBlly  Incorporating  probability  and  deci¬ 
sion  analytic  techniques  In  the  generation  of  expert  systems,  was  the  motivation  for  this 
research  effort.  Hollenga*s  five  step  method  for  expert  system  generation  and  MorlanV 
probability  ratio  graphs  for  probabilistic  knowledge  representation  present  two  Interesting 
ideas  that  address  the  problem  of  including  uncertainty  reasoning  In  sucli  systems.  Pro¬ 
gram  development  dealing  with  both  of  these  areas  uncovered  the  research  topics  iloscrlhed 
above.  Chapter  II  presents  a  view  of  the  current  state  of  uncertainty  ropvoseiitatlon  and 
reasoning;  there  does  not  seem  to  be  a  “correct"  Interpretation,  In  that  the  validity  of 
one  method  does  not  rule  out  other  methods.  Chapter  III  addresses  Morlan's  probability 
ratio  graph  concept  and  briefly  describes  the  current  state  of  the  created  software  that 
deals  with  probability  ratio  graphs  and  Hollenga's  five  step  method.  Chapter  IV  presents 
the  research  topics  on  missing  information,  independence,  and  second  order  uncertainty. 
Chapter  V  contains  conclusions  reached  about  the  topics  In  this  i  liesls,  as  well  as  possible 
areas  for  further  research. 
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II.  State  of  Uncertainty  Reasoning 

i,l  Background 

When  problemi  become  cvon  moderately  complex  the  human  mind  founders  in  a 
quagmire  of  Information.  Recognising  and  reacting  In  situations  when  the  available  in¬ 
formation  Is  incomplete*  or  insufficient,^  or  filtering  an  abundance  of  data^  for  pertinent 
information,  can  quickly  overwhelm  even  the  brightest  among  us.  At  such  times  we  in¬ 
variably  search  for  help  In  making  sense  of  this  seemingly  chaotic  information.  Managerial 
sciences,  operations  research,  artificial  Intelligence,  statistics,  decision  theory.., all  of  these 
fields*  purpose  Is  to  condition  and  massage  an  abundance  of  Information  Into  an  organised 
structure  with  a  relatively  small  set  of  discriminating  features  so  we  can  make  sense  of  the 
data  and  make  rational  decisions  based  on  the  data.  In  general,  experts  employ  similar 
conditioning  and  massaging  schemes  and  either  make  decisions  or  advise  those  who  do. 

More  complex  and  costly  problems  require  more  precise  and  accurate  answers.  Faced 
with  limited  experts  and  Increasing  demand,  decision  makers  have  to  rely  on  basic  rules  of 
thumb  and  procedures  provided  by  experts  which  may  apply  to  their  problem.  Tot  complex 
problems  these  rules  of  thumb  and  procedures  become  Inadequate  causing  the  decision 
maker  to  suffer  from  the  Information  ailments  (Incomplete  or  insufficient  Information,  or 
information  overload);  he  is  unable  to  process  the  available  information  coh(*roiuly  nnd 
thus,  the  decision  suffers. 

Expert  systems  are  an  attempt  to  create  automated  checklists  tliat  are  capable  of 
handling  complex  prohlems.  They  fill  a  need  for  access  to  export  knowledge  and  Judg¬ 
ment  when  true  experts  are  a  scarce  commodity.  Through  the  use  of  export  systems, 
experts’  knowledge  and  judgment  becomes  transportable  and  cumulative.  Knowledge  en¬ 
gineers  distill  experts'  knowledge  and  Judgment,  and  condense  It  into  a  prodellnod  slnicturo 

Mneomplete  Inforinallon-In  many  eui«a  of  dedilon  msklni  the  iltuklion  l«  under  ipeclfled.  The  avellitltla 
Information  may  be  either  Ill-defined  (vague)  or  iinptedeely  defined,  (9i000) 

^Iniufllclent  lnformatlon~ln  theie  cues  the  additional  Information  la  potentially  there,  but  a  eeparale 
and  specific  effort  Is  required  to  bring  It  out  (projections,  correlations),  (OiGOO) 

"Information  overllow-Thli  Is  the  case  of  too  much  information.  The  decision  maker  drowns  In  infor¬ 
mation  which  by  far  exceeds  what  he  can  process  or  comprehend  at  the  time  of  decision,  (0i0S7) 
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(knowUdgQ  bue)  that  an  “Inference  anglne”^  can  logically  luanlpulatu  to  nrrlvu  at  Ihu  same 
concluilon  aa  an  expert  given  ilmllar  clrcumitancei.  Expert  aystema  that  rely  on  these 
tranalated  rules  are  heurlatlc  in  nature  and  are  subject  to  translation  errors  resulting  In 
rules  that  do  not  capture  the  experts*  true  diagnostic  process. 

As  outlined  above,  there  are  two  facets  to  the  problem  of  automation:  1 )  Conditioning 
abundant  Information  to  produce  relatively  few  measures  that  approximately  doflnu  the 
state  of  the  world,  and  2)  Interpreting  the  resulting  measures  and  making  decisions  based 
on  them.  In  developing  systems  with  greater  autonomy  researchers  must  support  these 
facets,  meeting  the  Implied  requirements  of  well  defined  scope,  large  Information  handling 
capabilities,  Information  filter,  projection  or  forecasting,  recognise  Incomplete  Information, 
handling  uncertainty,  coherence  and  rationality,  while  avoiding  the  problems  of  Imprecise 
translation.  Those  requirements  call  for  both  mathematical  precision  and  heuristic  control. 

Operations  Research  (OR)  and  Artificial  Intelligence  (AI)  are  two  fields  that  are 
concerned  with  the  problem  of  supporting  decision  making  by  providing  high  level  Inter* 
pretatlou  of  the  state  of  the  world,  Simon  provides  working  definitions  of  these  two  fields 
with  the  understanding  that  both  fields  are  not  bounded  by  these  definitions. 


Operations  research  may  be  defined  u  the  application  of  optimisation  tech* 
nlques  to  the  solution  of  complex  problems  that  can  be  expressed  In  real  num* 
bers.  The  criterion  function,  which  determines  what  Is  to  be  optimised,  must 
also  bo  quantitative.  This  definition  Is  clearly  too  narrow  to  encompass  all 
the  things  that  operations  research  professionals  do.. .but  it  charnctorlsos  the 
predominant  emphasis  upon  formal  mathematical  models  and  oplimisiilln)i,,. 
By  contrast,  artificial  Intelligence  Is  the  application  of  methods  of  heuristic 
search  to  the  solution  of  complex  problems  that  (a)  defy  the  mathematics  of 
optimisation,  (b)  contain  non-ciuantltatlve components,  (c)  involve  largo  knowl¬ 
edge  bases  (Including  knowledge  expressed  In  natural  language),  (d)  incorporate 
the  discovery  and  design  of  alternatives  of  choice,  and  (o)  admit  lll-specllled 
goals  and  constraints. 

This  characterisation  of  AI  does  not  set  very  definite  boundaries.  It  might 
be  regarded  more  ns  a  hunting  license  than  as  a  proper  definition.  It  omphiisisos 


^Inferanco  engine  -  alio  known  as  control  ilructuie  or  conflict  reiolulloni  elmllir  to  an  algoritlun  Init 
more  general  and  leai  proclie.  The  way  facU,  rules,  and  parts  of  rules  ate  manipulated  Is  controlled  by  the 
Inference  engine  (16i9B), 
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the  aspiration  of  A1  to  deni  with  all  the  aspects  of  managorinl  ilocision  luakinii 

that  stretch  beyond  the  limits  of  classical  OR,  (17:10*11) 

Most  problems  have  components  that  are  best  handled  with  OR  methods  and  other 
components  that  are  better  addressed  with  AI's  heuristics,  It  is,  thoroforo,  advantageous 
to  combine  and  synthesise  OR  and  Al,  supporting,  reinforcing,  and  extending  each  other 
(17:11).  Others  have  also  recognised  the  usefulness  of  a  symbiosis  between  OR  and  Al. 
One  area  of  Interest  Is  the  Incorporation  of  decision  theory  into  the  development  of  expert 
systems.  Kalagnanam  and  Henrion,  Breeio  and  Fohling,  and  Heckorinan,  to  name  a  few, 
have  produced  research  in  this  area.  Combining  OR  and  Al  methods  has  great  potential 
for  producing  more  powerful  decision  support  and  autonomous  systems.  Though  united  In 
the  goal,  researchers  are  divided  on  the  path  and  what  final  form  those  symbiotic  expert 
systems  should  take. 

Aulomdh'nff  the  Etpert 

Automation  Is  the  '^automatically  controlled  operation  of  an  apparatus,  process, 
or  system  by  mechanical  or  electronic  devices  that  take  the  place  of  human  organs  of 
observation,  effort,  and  decision."  When  speaking  of  automating  a  process,  care  must  be 
taken  to  specify  to  what  degree  the  process  Is  automated.  There  Is  some  automation  In 
every  action  that  relies  on  a  machine  or  tool.  The  goal  of  automation  is  not  to  remove  the 
power  of  human  self  determination  but  to  relieve  the  hutnan  from  the  burden  of  mundnne 
or  information  intensive  tasks  so  that  more  worthy  undertakings  c.iin  be  pursued.  It  also 
allows  for  the  speed  :nany  operations  require  and  which  humans  cannot  provide. 

A  major  point  of  contention  on  achieving  automation  Is  the  underlying  pitllusopliy 
of  current  and  proposed  methods.  Expert  systems  are  proving  valuable  In  automating 
decision  support  and  process  control.  However,  the  quality  of  these  ex|>ert  systems  is 
questionable  duo  to  Imprecision,  uncertainty,  and,  In  part,  to  the  “discouraging  observa¬ 
tion. ..that  today's  systems  seem  to  be  successful  because  they  are  ‘hniul  crafted'  rather 
than  because  they  apply  a  set  of  proven  techniques  and  methods''  (10:7^0),  These  'haiul 
crafted*  methods  and  Ingenious  heuristics  are  the  source  of  much  plillosopliic.  debate  on 
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the  form  that  those  systoms  should  take.  The  methods  far  inanipulaliiig  uiin'i  taiuly  conu' 
under  scrutiny  as  does  expert  emulation  and  rationality  In  the  artificial  decision  maker. 


Vnetriainty  Uncertainty  Is  generally  characterized  as  resulting  from  stochas¬ 
tic  processes,  linguistic  vagueness,  and  subjective  belief.  Stochastic  uncertainty  is  usually 
measured  with  statistics  and  arises  when  referring  to  random  events  such  as  rolling  a  dio,  or 
spurious  events  like  accidents  or  faulty  readings.  Linguistic  vagueness  results  from  impre¬ 
cise  definition  where  terms  have  variable  meanings;  compare  numbers  which  are  discrete 
and  well  defined,  and  therefore,  not  vague  (two,  three,...),  with  “a  few."  Zadeh  developed 
the  concept  of  fussy  sets  to  deal  with  such  vagueness.  Subjective  bollofs  are  the  pre¬ 
dominant  source  of  uncertainty;  subjective  uncertainty  prevails  In  ono-of-a-klnd  situations 
whore  someone  makes  an  assessment.  Dayeslan  statisticians  argue  that  It  Is  the  only  typo 
since  subjective  Interpretation  Is  Involved  In  communication  and  data  assimilation  (ISiS). 

Whatever  Its  source,  a  successful  expert  system  must  be  able  to  deal  with  uncertainty, 
rrobablllty  is  perhaps  the  method  best  known  for  representing  uncertainty,  lu  Is  classical 
Bayesian  Inference,  for  reasoning  under  uncertainty.  It  is  valid  and  has  a  sound  theoretical 
foundation.  However,  classical  Dayeslan  evidential  reasoning  becomes  so  computationally 
Intensive  as  to  be  Intractable  when  applied  to  a  non-trlvlal  decision  problem.  “It  ra(|ulr«s 
a  detailed  listing  of  all  possible  scenarios  which  Is  Imvossiblo.  The  apparent  need  for  [a] 
huge  distribution  of  cases  Is  the  major  objection  to  using  Dayeslan  probability  theory  In  n 
real  expert  system.”  (18:8)  Various  methods  (certainty  factors,  fuzzy  sot  theory,  Dumpsltu'- 
Shoafor  theory)  arouse  controversy  when  they  avoid  Dayeslan  conditioning  In  n:i  attempt  to 
skirt  computational  Intractability  (12:271).  Kyberg  states,  “non- Dayeslan  updating  yields 
more  determinate  belief  states  as  outcomes,  but  the  benefits  afforded  by  non- Dayeslan 
updating  are  limited  and  questionable.”!  12:28(1) 

All  methods  for  dealing  with  uncertainty  must  have  some  measure  which  characieii/es 
the  amount  of  uncertainty  there  Is  In  a  proposition  and  some  interpretation  of  that  measure’, 
The  following  four  methods  are  some  of  the  more  well  known  theories  for  characterl/Ing 
uncertainty. 
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t.t.l.l  Bayeaian  Probability  theory  Probability  Is  an  assossmont  about  tho 
frequency  of  events.  Its  roots  lie  In  games  of  chance  (dice,  cards,  roulette,  etc...),  whoro 
the  probability  of  an  event  la  the  number  of  poeslble  occurrences  of  €  divided  by  the  total 
number  of  possible  outcomes  5; 


P{£)^ 


#  oj 

#  of  Sa 


An  example  is  tho  probability  of  drawing  an  ace  out  of  a  deck  of  cards; 


#  of  Aeta  4 

P{A)  - - =•  75  *  0.07002 

#  of  Carda 


Probability  reasoning  Is  based  on  Bayes*  theorem^,  which  plays  a  central  role  In  ol> 
ementary  probability.  It  Is  a  general  rule  for  the  computation  of  a  posterior  probability 
P(Ak  I  0)  from  prior  probabilities  P{A{)  and  conditional  probabilities  P{B  |  ,40  (I^o- 
vore;60).  This  theorem  presents  the  mathematical  equation  for  combining  probabilistic 
assessments  coherently  and  consistently: 

Bayes*  theory  U  based  on  conditional  probabilities  and  allows  for  probabilistic  inferi'iices 
when  evidence  Is  observed.  I'Vir  Instance,  In  the  card  example  almvo,  the  l*(A)  r.  .i/TiV 
given  that  there  arc  four  aces  in  the  deck.  This  Is  a  conditional  probability,  os  are  all 
inoasures  of  uncortiduty,  being  conditioned  at  least  upon  the  sot  of  possible  cards.  All 
events  are  conditional  in  that  there  Is  a  set  of  conditions  whether  explicit  or  Implicit  that 
exits  or  deflncB  tho  situation  for  which  a  proposition  Is  valid. 

There  arr  various  arguments  against  using  probability  for  reasoning  with  uncer¬ 
tainty,  Two  Important  arguments  arc  that  It  docsn*t  reflect  the  way  people  reason  and 
that  It  becomes  computationally  intractable.  Arguments  against  probability  spurred  the 

*Bay«s'  theorem  Is  named  after  Its  eighteenth  century  originator,  llevi^raiul  Thumtui  lUyni. 
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development  of  other  methode  for  representing  and  reasoning  with  uncertainty, 

tJ.J.S  Certainty  Factors  Certainty  factors  originated  from  Bayes*  theorem. 
They  were  developed  to  handle  uncertainty  in  MYCIN^  when  the  Bayesian  Inferential 
method  became  Intractable  both  computationally  and  with  respect  to  data  requirements. 
In  their  book,  '*Rule-Based  Expert  .Systems;  The  MYCIN  Experiments  of  the  Stanford 
Heuristic  Programming  Project,**  Buchanan  and  Shortllffe  explain  the  development  of  cer¬ 
tainty  factors  (1). 

Certainty  factors  represent  uncertainty  as  reasons  of  belief  using  measures  of  belief, 
and  disbelief,  MD{Hy£)  where  Is  a  hypothesis  and  £  Is  an  evidence  state. 
These  measures  are  computed  separately,  and  are  then  combined  to  represent  the  total 
uncertainty  as  a  certainty  factor,  CF(W,f)  ■  MB{'H^£)  -  MD{'H^£), 

The  MB  and  MD  both  range  between  0  and  1,  giving  the  CF  a  range  of  -1  to 
1.  A  positive  CF  Indicates  more  belief  than  disbelief  and,  conversely,  a  negative  CF 
Indicates  more  disbelief  than  belief,  A  CF  of  0  Indicates  that  there  Is  equal  belief  In  both 
propositions  and  notH  (d;ft61), 

Some  criticisms  levied  against  certainty  factors  are  1)  that  the  combining  rules  are 
arbitrary,  2)  they  assume  evidence  Independence  (5:0),  and  3)  they  do  not  have  a  sound 
theoretic  basis  (<t:602).  Although  certainty  factors  are  derived  from  probability  theory, 
they  are  not  probabilistic.  I'lioy  abandon  probabilistic  rules  In  an  attempt  to  reduce 
the  computational  burden  and  data  requirements.  They  work  quite  well  as  long  as  the 
reasoning  path  Is  short  and  the  Inherent  errors  do  not  build  up.  However,  “It  Is  not  didlctdl 
to  come  up  with  an  example  In  which,  of  two  hypotheses,  the  one  with  the  lower  probability 
would  have  a  higher  certainty  factor...  This  failure  to  rank  according  to  probability  Is  an 
undesirable  feature  of  certainty  factors,'*  (1:260) 

Fuxsy  Set  theory  Pussy  sots  are  sots  whore  the  borders  are  not  crisply 
defined  (tall,  fast,  heavy,  etc,..).  Linguistic  uncertainly  comes  from  Just  these  ly|)i>H  t)f 
terms  whore  the  meaning  can  vary  from  person  to  person.  The  uncertainty  arises  from 

*MYCIN  Is  s  rule-bssed  espert  system  used  (or  medical  consullslloii, 
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the  Interpretation  of  what  someone  else  means  when  they  use  those  terms.  Fuzzy  sots 
attempt  to  represent  sots  as  analog  or  continuous  where  conventional  set  theory  is  digital 
or  discrete. 

With  conventional  set  theory  an  item  can  bo  in  one  of  two  states  with  respect  to  a 
set:  in  or  out.  Probability  would  represent  the  uncertainty  between  those  two  states.  The 
degree  of  membership  is  not  in  question;  it  is  either  all  in  one  or  all  in  the  other.  With 
fussy  sets,  the  degree  of  membership  is  in  question:  how  much  In  or  how  much  out.  A 
member  at  the  same  time,  be  in  both  a  sot  and  its  complement. 

Zadch  used  fussy  set  theory  to  extend  two-valued  syllogistic  reasoning  to  allow  an 
Indication  of  doubt  In  the  premises  or  conclusion.  He  accomplished  tills  by  attaching 
arbitrary  predicates  to  each  teim  of  the  syllogism: 

Q\  A*»  are  0's 
Q2  are  P's 
Q3  £*a  are 

whore  Ql,  Q2,  and  Q3  are  numerical  or,  more  generally  fuzzy  (luantldors  (0.8,  most, 
many,  etc.),  and  >1,0,...  are  crisp  or  fussy  predicates. 

Fussy  sot  theory  lends  Itself  to  applications  using  a  rule  base.  However,  the  ruluH 
are  directional  and  lnfle.Nlble;  they  cannot  take  Into  account  factors  that  aru  not  explicitly 
stated  In  the  rules,  making  them  context  Insensitive  (Independent  from  conditions  not 
Included  in  the  rule).  Conversely,  with  Bayesian  probability  theory  the  connections  aru 
directionless  and  conditional  indepondonco  Is  explicit,  not  Imposed  by  the  formal  structure 
(18:840). 


Dempater-Sheafer  theory  With  Dompstor-Shoafor  theory  the  uncer¬ 
tainty  In  the  probability  assessment  is  Implicitly  represented  as  unattributed  probability. 
Fbr  instance,  given  two  mutually  exclusive  and  colioctivoly  exhaustive  ovuutsi  A  and  uoM, 
P{A)  n  .6  and  PinolA)  »  .1,  the  remaining  .3  la  loft  unspoclflod.  The  unspecldud  proba¬ 
bility  represents  the  subjective  ignorance  about  the  objective  probability  of  A,  which  could 
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lie  anywhere  between  .6  and  .9.  The  Inclusion  of  the  unspecifled  probability  constitutes  a 
type  of  seniltlvlty  analysis.  It  delineates  the  precision  of  the  information  and  the  improve¬ 
ment  that  may  be  possible  in  gathering  further  Information  about  A,  Probability  theory 
can  accomplish  this  same  task  by  explicitly  representing  the  subjective  ignorance  (18:0). 


Today  It  seems  ai  If  there  were  a  conflict  between  the  Dayoslans  and  the 
Shaferlans  in  the  field  of  AI  applications  of  probabilistic  Inference.  True,  this 
seems  rather  to  be  the  Bayeslans*  stand...The  view  of  the  other  pouitlon  Is  that 
Shafer’s  theory  Is  a  generalisation  of  Bayesian  theory,  thus  seemingly  implying 
broader  possibility  of  applications... 

The  point  here  is  that  Dempster's  rule  can  be  understood  as  a  genorali nation 
of  Bayes  theorem,  but  it  Is  not  the  unique  possible  generalisation.  It  Is  this 
non^uniqueness  that  creates  the  Justification  problem... 

In  general,  we  can  say  that  recent  work  In  the  field  called,  among  philoso¬ 
phers,  'probability  klnematlcs*...has  shown  that  there  exists  an  entire  class  of 
kinematics  or  generalised  conditionals  In  the  belief  space  given  by  all  admissi¬ 
ble  probabilities  in  a  frame  of  discernment,  and  that  conditionals  (both  Bayes 
and  generalised)  are  nothing  more  than  rules  for  combining  posterior  bodies 
of  evidence  with  prior  bodies  of  evidence.  The  belief  space  is  endowed  with 
certain  structure  and  a  particular  operation:  provided  that  different  conditions 
hold,  this  operation  reduces  to  different  conditionals  or  different  combinations 
rules  as  its  own  particular  cases.  (2:709-710) 

The  choice  of  which  method  to  use  is  not  clear.  The  debate  seems  to  loan  in  tlio 
favor  of  the  Bayeslans.  However,  both  methods  claim  a  following,  and  the  choice  of  wiilclt 
to  support  seems  to  depend  on  context.  Oarbolino  goes  on  to  suggest  that, 


There  Is  no  mechanical  method  for  deciding  which  probabilistic  rules  of 
inference  to  apply  In  a  given  decision  problem.  This  decision  Is  a  metii-dccislon 
which  depends  upon  the  Ingenuity  of  the  decision-maker  and  his  associates  In 
analysing  the  problem,  upon  the  logical  structure  of  the  frame  in  which  It  is 
possible  to  embed  the  problem,  upon  the  'quality'  of  the  available  evidence 
and  upon  the  constraints  in  time  and  resources  (even  computational  resources) 
which  could  prevent  a  refinement  of  the  frame  of  discernment.  (2:715) 


So  the  method  la  left  up  to  the  decision-maker  and  is  context  dependent.  Still  a 
possible  guideline  is  that  the  chosen  method  should  adhere  to  logical  coherence.  WItli  this 
in  mind,  Oarbolino  provides  a  basis  for  choice; 
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The  updeting  procedure  for  a  knowledge-base  is  a  two-atep  procedure;  the 
first  step  is  calculating  the  degree  of  support  provided  by  the  new  evidence;  the 
second  step  is  updating  the  process  properly  said,  that  is,  propagating  the  effect 
of  the  new  evidence  through  the  knowledge-base,  maintaining  its  coherence. 
(3!735) 

Bayesian  updating  accomplishes  these  two  steps  simultaneously;  Shafer’s  updating 
accomplishes  the  first  one  only  and.  If  one  is  Interested  in  coherence,  it  raises  the  need  to 
supply  to  the  Inference  engine  a  **coherence  m^ntenance”  mechanism  (3:730). 

It  Is  not  clear  that  there  is  a  "correct”  method  for  dealing  with  uncertainty.  Applica¬ 
tion  determines  the  tool  that  should  be  used.  Of  the  four  methods  listed,  fuzzy  set  theory 
attempts  to  quantify  linguistic  uncertainty  and  certainty  factors  are  a  heuristic  derivation 
of  probability  theory  attempting  to  control  computational  and  data  burdens;  probability 
theory  and  Dempster-Sheafer  theory  attempt  to  describe  general  uncertainty  and  support 
it  with  a  theoretical  foundation. 

Of  the  four  methods  above,  Bayesian  probability  is  the  only  method  that  demon¬ 
strates  consistence  and  logical  coherence,  The  other  methods,  though  are  in  some  sense 
appealing  representations,  are  restricted  due  to  their  lack  of  demonstrated  consistence  and 
coherence. 


[Kyberg  concludes], ..il)  That  the  treatments  of  uncertain  evidence  in  both 
Bayesian  and  non-Hayesian  updating  are  reducible  to  the  corresponding  treat¬ 
ments  of  certain  evidence,  and  ill)  that  non-Bayosian  updating  yields  more 
determinate  belief  states  as  outcomes,  but  that  the  benefits  afforded  by  non- 
Bayeslan  updating  is  limited  and  questionable.  (12:285) 


This  doesn't  end  the  debate,  for  tlie  real  roots  of  controversy  lie  in  the  criticism  tiiut 
people  do  not  use  probability  for  reasoning,  and  thus  follows  the  disagrooment  between 
those  who  support  the  normative  view  and  those  who  support  the  deacriptive  view.  Tills 
disagreement  over  representation  Is  more  philosophical  than  metliodologlcal.  Probablllsts 
take  the  normative  view,  saying  that  uncertainty  should  be  represented  not  as  people  boo  It, 
but  as  they  should  if  they  want  to  act  consistently  and  logically.  Proponents  subscribing  to 
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the  descriptive  view  believe  that  uncertainty  should  bo  represented  in  a  manner  consistent 
with  the  way  people  represent  it  (15:3). 

Emulation  When  the  expert  system  rule  base  is  compiled,  knowledge  engi¬ 
neers  attempt  to  capture  the  knowledge,  Judgment,  and  diagnostic  process  of  the  expert, 
Often  the  translation  from  the  expert's  framework  into  the  rule  base  is  imprecise,  resulting 
in  rules  that  do  not  capture  the  true  experience  of  the  expert.  This  is  not  surprising  since 
humans  are  not  machines  and  do  not  think  as  computers  process  Information.  "The  foun¬ 
dation  for  human  reasoning  is.. .rather  vague,  since  on  the  whole  the  mind  must  still  be 
considered  u  a  black  box"  (10:745).  Because  the  human  reasoning  process  evades  explicit 
understanding,  the  task  of  emulating  the  expert  is  practically  Impossible.  The  best  that 
can  be  hoped  for  is  good  pattern  matching  (0:670). 

fbr  uses  where  rational  reasoning  is  desired,  attempting  to  emulate  humans  seems 
to  be  misdirected.  As  Qarbolino  states,  "a  procedure  which  models  natural  reasoning 
yields  a  conclusion  based  upon  natural  reasoning,  not  a  rtaionable  conclusion  based  upon 
reasonable  reasoning"  (3:730).  However,  natural  reasoning  should  not  be  abandoned  Just 
yet,  because,  though  we  lack  the  quantitative  skills  to  handle  data  efUclontly,  humans  can 
adapt  and  function  in  unknown  territory: 


Human  reasoning  is  generally  acknowledged  to  be  IneiHclent  in  terms  of 
accuracy  and  speed,  but  highly  efRcient  in  terms  of  versatility  and  the  ability  to 
comprehend  novel  events...  Artificial  systems,  on  the  other  hand,  must  be  told 
everything  beforehand.  If  the  domain  is  sufRciently  simple  and  well-described, 
an  artificial  system  may  do  well  and  may  even  surpass  humans  in  terms  of 
sheer  reasoning  power  (speed,  endurance,  precision).  But  if  the  domain  is  more 
complex,  and  in  particular  if  novel  situations  can  arise,  the  artificial  system 
will  probably  encounter  serious  difncuitles.  (10:743-746) 


The  strength  of  human  reasoning  lies  in  its  adaptability;  its  ability  to  reason  about 
the  unknown.  If  the  fundamental  mechanisms  underlying  human  thought  can  be  captured 
in  a  computer  system,  then  artificial  Intelligence  will  no  longer  be  an  oxymoron.  Capturing 
the  underlying  process  is  a  worthy  goal,  but  until  the  fundamental  mechanism  is  captured. 
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attempts  to  emulate  the  human  mind  will  remain  empirical  in  nature  and,  therefore,  be 
restricted  in  applicability. 

fl.i.S  Rationality  The  Importance  of  a  rational  decision  maker  in  automated  sys¬ 
tems  stems  from  the  issue  of  responsibility.  ''Users  often  rely  blindly  on  the  programs 
they  use,  e.g.  large  statistical  packages,  and  the  faults  in  these  programs  therefore  have 
potentially  serious  consequences”  (9:676).  To  avoid  unpredictability,  a  system  must  ex¬ 
hibit  logical  coherence'^,  A  system  should  reach  the  same  conclusion  when  given  the  same 
evidence  regardless  of  the  order  in  which  It  is  presented^. 


A  perennial  question  concerns  the  level  of  rationality  of  the  decision  maker, 
hence  the  quality  of  the  cognitive  processes  that  must  be  described.  It  is  gen¬ 
erally  acknowledged  that  decision  makers  are  far  from  being  rational  in  any 
normative  sense,  The  question  remains,  however,  whether  decision  makers 
should  be  considered  as  Inherently  irratlonal-and  accordingly  in  conflict  with 
established  decision  principles-or  rather  as  quasl-rational,  i.e.  striving  to  per¬ 
form  according  to  rational  principles,  but  falling  to  do  so  (because  of  cognitive 
limitations,  etc.).  (9:671) 


The  term  quaai-rational  is  essentially  bounded  rationality.  Bounded  rationality  is 
a  model  of  how  decisions  are  made.  People  make  decisions  based  on  maximizing  utility; 
limitations  on  the  amount  of  information  and  the  ability  to  process  it  colierently  cause  the 
appearance  of  bounded  behavior  (14). 


If  your  task  is  to  build  a  machine  for  simulating  [the]  human  mind,  then 
it  is  true  that  coherence  is  not  relevant,  and  if  you  will  succeed  in  building  an 
Incoherent  machine,  you  will  be  a  good  scientist  Indeed.  But  if  your  task  is, 
more  modestly,  to  build  a  machine  for  ''Intelligent  decision  support,"  then,  if 
you  do  not  care  about  the  logical  coherence  of  your  machine,  you  are  a  new 
Dr.  Strangelove.  (3:735) 


’'To  be  logically  coliennt,  belief)  muit  not  be  lelf-contr&dictory;  a  knowledge- base  must  not  contivin  at 
the  same  time  a  proposition  and  Its  negation  (3i738). 

"This  does  not  mean  that  sequence  of  occurrence  is  Irrelevant.  However,  if  sequence  is  important  then 
it  evidence  that  should  be  Included  for  consideration. 
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It  seems  the  prudent  course  of  action  would  be  to  apply  artificial  systems  in  ways  l  lial 
they  are  ofilcient  and  capable,  helping  the  decision  maker  remain  rational.  This  means  ex¬ 
ploiting  their  ability  to  keep  track  of  large  amounts  of  information  and  the  inter- rclatlonshli) 
of  it,  while  keeping  focused  on  the  guiding  principle  of  logical  coherence  throughout  system 
development. 


i,S,4  Decision  Analysis  Decision  analysis  Is  ideally  suited  for  decision  support  if 
logical  coherence  Is  a  criterion  for  selection.  Decision  analysis  tackles  rare  problems  that 
are  large  and  cumbersome,  providing  organization  and  methodology  for  logical  reasoning 
In  decision  making.  Decision  analysis  has  been  employed  for  complex  decision  problems 
because  it  is  rational  and  logical,  consistent,  and  can  incorporate  utility  into  the  decision 
process. 


Decision  analysis  (D/A)  provides  the  tecltnlques  to  allow  for  an  explicit 
representation  and  organization  of  the  decision  factors,  such  that  logic  can  bo 
applied  to  identify  the  preferred  decision  strategy.  The  axioms  on  which  it  is 
based  provide  a  set  of  criteria  for  consistency  among  beliefs,  preferences,  and 
choices  that  “should**  be  adhered  to  by  a  rational  decision  maker.  The  D/A 
methodology  provides  a  systematic  way  to  choose  among  alternatives  by  con¬ 
sidering  the  problem  structure,  uncertainties,  and  relative  utilities  of  pursuing 
different  options.  Finally,  the  process  of  developing  probability  and  utility  es¬ 
timates  yields  a  model  that  can  be  validated  piecemeal,  yet  with  a  structure 
that  ensures  a  level  of  validity  In  the  completed  model,  and  a  methodology  for 
validating  the  completed  decision  aid.  (8:2) 


The  pursuit  of  a  rational  decision  maker  can  succeed  through  the  use  of  decision 
analysis.  Furthermore,  because  decision  analysis  uses  Dayesian  inference  for  evidence  luii- 
nlpulation,  it  is  coherent  and  therefore  conforms  to  the  philosophical  requirements  outlined 
above,  Recent  research  Is  lending  support  to  the  conclusions  of  this  philosophical  approach, 
Kalagnanam  and  Henrion  compared  decision  analysis  and  expert  rules  for  sequential  diag¬ 
nosis: 


The  results  of  this  study  clearly  Indicate  that  the  test  sequences  provido[d] 
by  the  experts  (In  the  task  domain)  are  suboptimal.  Unfortunately,  there  Is 
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uncertainty  regarding  the  objectives  which  motivate  the  expert  test  sequences. 
This  restr^ns  us  from  drawing  firm  conclusions  about  the  efficacy  of  human 
intuition  for  this  task  domain.  But  it  is  important  to  remember  that  one  of 
the  experts  accepted  the  validity  of  the  C/p°  sequence  and  felt  that  the  results 
are  likely  to  be  of  practical  interest.  This  suggests  that  the  normative  theories 
of  decision  making  are  capable  of  obtaining  results  which  go  beyond  current 
expert  opinion.  (11:211) 


Heckerman  relates  a  situation  v'here  an  expert  user  noticed  a  marked  improvement 
in  the  performance  of  a  diagnostic  system  when  they  changed  the  inference  scheme  from 
one  based  on  Dempster-Shafer  theory  of  belief  to  one  based  on  a  special  case  of  Bayes* 
theorem.  In  this  study,  Heckerman  compared  throe  inference  approaches: 


•  a  special  esae  of  Bayes’  theorem 

•  an  approach  related  to  the  parallel  combination  function  in  the  certainty-factor  (CF) 
model 

•  a  method  inspired  by  the  Dempster-Safer  theory  of  belief 

Heckerman  points  out  the  observed  superiority  of  the  method  based  on  the  Bayesian 
approach  (6:158,  166-168). 

To  date,  automated  systems  are  still  just  computer  code  and  cannot  replace  humans 
for  the  chore  of  facing  unique  situations.  The  domain  of  an  arlillclal  system  must  be 
completely  specified  beforehand.  “Put  simply,  unless  the  system  knows  about  somctliing, 
It  is  unable  to  reason  about  it”  (10:746).  Decision  analysis  has  proven  to  be  a  rational, 
consistent  decision  maker,  This  makes  it  ideally  suited  for  reasoning  with  uncertainty  In 
automated  systems.  Until  a  sound  foundation  for  understanding  human  thouglit  can  be 
quantified  and  codified,  emulation  of  the  human  expert  by  computers  is  a  field  where  smoko 
and  mirrors  prevail  and  only  systems  endowed  with  artfully  constructed  heurlstlcn  play. 

*C/p  refers  to  the  algorithm  used  In  the  study.  'C  refers  to  the  cost  of  testing  a  component  and  ‘p’ 
refers  to  the  probability  of  that  component  falling. 
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il,3  Summary 

This  chapter  presented  a  view  of  the  present  state  of  uncertainty  reasoning  and  expert 
systems  from  both  an  operational  and  a  philosophical  perspective.  As  presented  above,  the 
representation  of  uncertain  knowledge  has  many  possible  paths  that  are  intuitively  pleasing 
in  presenting  different  concepts  of  uncertainty.  Questions  about  applicability  arise  when 
the  methods  are  used  for  reasoning  with  uncertain  information.  The  fact  that  the  methods 
are  different  isn't  an  immediate  problem;  the  lack  of  consistency  and  logical  coherence  Is 
a  problem.  Probability  theory  demonstrates  these  properties  while  the  other  methods  do 
not.  From  a  theoretical  standpoint,  the  lack  of  consistency  and  logical  coherence  Is  a  major 
litmus  test;  if  a  method  does  not  demonstrate  these  properties  they  are  basically  empirical 
in  nature  and  have  a  restricted  range  of  validity.  For  operational  use  an  empirical  method 
is  as  good  as  a^y  as  long  as  it  operates  within  its  valid  range. 

Though  probability  has  a  firm  theoretical  foundation,  there  remains  room  for  rep* 
resentatlon  and  interpretation  of  the  probability  model.  Chapter  III  presents  probability 
ratio  graphs  which  is  a  representation  of  the  probability  model.  Chapter  IV  presents  sov< 
eral  interpretations  on  how  probability  deals  or  can  deal  with  some  differing  facets  of 
uncertainty. 
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III,  Probability  Ratio  Orapha:  An  interpretation 

And  vihat  ia  a  uieedf  A  plant  whose  virtues  have  not  been  discovered. 

-Ralph  Waldo  Emerion 

Tha  baalc  archltactura  addraiiad  by  the  raiaarch  tool  U  an  Implemautatlon  of  the 
format  deicrlbad  by  Morlan  in  hia  paper  M  Decision  Analytic  Approach  to  Building  Bxj/eti 
Systems. "  In  thla  paper  Morlan  develop!  a  format  baaed  on  odda>ratloa  for  repreaenting  a 
declalon  analytic  framework  with  probability  ratio  graphs.  Ho  pointa  out  that  the  chosen 
representation  for  a  mathematical  model  only  serves  to  clarify  meaning  for  the  modul 
builder  and  hu  no  effect  on  the  underlying  mathematics.  (ISil)  The  odds>ratla  formal  U 
Ideal  for  representing  the  Information  required  for  the  decision  analytic  approach i 


1.  P(£j  I  conditional  prohabllltlea  or  likelihoods  for  the  evidence  and  hy> 

pothesos. 

P('Hi)  -  the  prior  probabilities  for  the  hypotheses. 

3,  I  Hi)  -  the  utility  Information  for  the  hypothosoa  and  actions'. 

The  Information  listed  Is  needed  for  making  optimal  decisions  under  uncertainty. 
Morlan  shows  that  the  relative  utilities  between  competing  actions  is  Important,  not  the 
absolute  values.  The  Information  needed  for  determining  those  relative  lUiliiioN  U  cunlulned 
In  the  rj^s  between  the  hypotheses  and  actions.  (13;.1)  Thu  following  discussion  on 
probability  ratio  graphs  Is  adapted  from  Morlan 's  work  and  Is  only  an  overview  of  the 
material  contained  therein''. 


‘This  notsllon,  U(Ak  |  Tii),  reprawnli  ilia  utility  of  performing  sclloii  Ai,  wiimt  liypatliaalu  H.  U  tliu 
true  state  of  the  world  (13i23). 

’The  forthcoming  dlicuiilon  U  s  condensed,  sdsplcd  version  of  Morlan 'n  preieitl&lion.  Sumo  aroM  Iiavo 
been  simplified  and  other  sspects  Interpreted.  For  sn  in-depth  msthemsticsl  prosonlstlon,  the  orlglnitl 
document  should  be  lollclted. 
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9,1  Probability  ratio  grapha 

Th«  rsNirch  tool  cmployi  probability  ratio  graphs  for  representing  the  likelihood, 
prior,  and  utility  Information  necessary  for  using  the  decision  analytic  approach.  There  are 
many  approaches  for  representing  probability  (Venn  diagrams,  contingency  tables,  causal 
nets,  probability  trees,  to  name  a  few).  Probability  ratio  graphs  present  another  face  In 
the  crowd  representing  the  same  mathematics  of  probability.  They  are  similar  to  Influence 
diagrams  and  causal  nets,  providing  a  method  for  decomposing  ungainly  probability  models 
Into  manageable  configurations,  However,  probability  ratio  graphs  offer  advantages  when 
addressing  the  concerns  of  completeness  and  vididatlon.  They  also  clarify  Implications  of 
Independence  assumptions  by  explicitly  mapping  the  transfer  of  statements  about  causal 
dependence  Into  the  mathematics  of  probability  distributions. 

The  fundamental  concept  underlying  probability  ratio  graplis  Is  that  In  decision  mak> 
Ing  the  discriminating  feature  between  competing  alternatives  Is  their  relative  measure. 
The  ratio  of  their  measures  captures  the  Important  Information  In  the  decision  analytic 
sense. 

The  function  of  probability  ratio  graphs  Is  the  representation  and  manipulation  of 
probability  and  utility  relational  Information.  The  representation  Involves  two  basic  con* 
struclsi  vertices  and  arcs.  The  manipulation  function  uses  two  basic  proced\iresi  trlangu* 
latlon  and  aggregation. 

9,1,1  Pepreaenlalion  The  tirst  function  of  the  probability  modul  Is  rcpresimllng 
marginal  and  conditional  probabilities.  Figure  1  shows  how  the  two  basic  constructs  ari' 
related  In  a  compound  probability  ratio  graph  (0  will  hereafter  represent  a  probability  ratio 
graph).  Various  combinations  of  thuse  constructs  can  represent  (|ultu  complex  nnyeslait 
Inference  problems  Involving  many  levels  of  disjoint  hypotheses  and  their  correspniidlng 
evidence  states.  The  following  definitions  will  help  facllllale  discussion: 

Event!  An  assignment  to  a  random  variable,  or  set  of  random  variables. 
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Flgur*  1.  A  com))ouiid  probAbllUy  ratio  graph. 

Vartcxi  All  «v«iit  and  an  ombaddad  probability  ratio  graph.  Thu  uvunl 

could  ba  a  hypothuiua  reproioiitliig  a  poiilblu  Rtatu  of  thu  world 
or  a  pomlbltovldoiict  itata  which  U  uiud  to  roMoii  about  thu  put- 
•Ible  hyputhoiui.  Tho  enibudded  Q  reproionlN  conditional  prob* 
abllltlfin,  conditioned  on  the  parent  vertex. 

Aret  A  directed  weighted  arc  connecting  two  vortlceN  which  are  on  the 

eatnc  level.  It  haa  three  aasoclated  parainoterHi  Hoad,  Tail,  and 
Uatlo. 

{{llrnii,raU)Jinlio) 

Tho  head  can  be  thought  of  a«  whore  tho  are  uriginatim;  IlkowUo, 
the  tail  In  where  tho  arc  endH.  The  ratio  In  the  ratio  of  the 
probabllltloM,  head  to  iaift 

Graph!  A  let  of  vertlccN,  V,  and  a  sot  of  arm,  A,  connecting  iIiuno  ver* 

tlcoi.  Ill)  bo  a  legitimate  probability  nttio  gmph  two  cundltloiiH 
mint  bo  met  I 

1,  The  Net  of  vortlcoN.  V,  iiunt  furin  a  Kot  of  mutually  excluNive 
evenlN. 

12.  Tho  arm,  A',  muNt  form  a  minimal  Npantiing  tree  (no  cycloH). 
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9,J,i  Manipulation  The  lecond  function  of  tho  probability  model  U  Implomonting 
probability  ealcului  conilitantly.  Probability  ratio  graphs  uie  two  basic  types  of  functlonN 
to  perform  probability  calculus;  1)  triangulatlon,  and  3)  aggregation  and  disaggregation. 


Figure  3.  A  graphic  depiction  of  trlaiigulatlon, 


TrlanguUtlont  Allows  the  computation  of  a  missing  third  arc,  given  the  two 
arcs  which  together  with  tho  third  arc  form  a  triangle,  Figure  3 
shows  tho  function  of  triangulatlon.  Its  use  will  become  evident 
In  later  examples, 


Given  the  situation  as  described  In  hgure  3)  triangulate  between  vertices  from  ('  to 
Ai 


Note:  The  arcs  are  directional.  If  the  triangulailun  was  from  A  to  then, 


Klguro  3.  A  graphic  depletion  of  aggragatlon. 


Agfrogailont  Allowi  for  the  uxpanalon  uf  an  einbadded  0  up  one  level  while 
maintaining  the  original  probabllUtlc  rolatlonihlpi.  Aggrega> 
tlon  change!  the  probablllatlc  rolatlonahipa  of  the  embedded 
graph  from  conditional  probablllttoi  Into  Joint  probablllllei. 
Figure  3  li  a  graphic  repreientation  of  aggregation. 

Example  S.3  Aggregation 


Given  the  eltuatlon  m  described  In  llgure  3,  aggregate  the  vertlceH  A  and  ('  from  /v'; 


r{A).j  /*(/f)  .  riK) 

no'  /’(/■')'  no 


X  a 


P{A)  TTj 


«  a 


I 


» _ 

I  +  ! 


Note!  The  original  connection*  and  arc  direction*  dutormlne  how  the  arc  weight* 
are  combined. 

Note!  According  to  Marian,  the  term  ''aggregation*'  refer*  to  the  traiiNfurmatlon  of 
two  graph*  Into  one  graph. 
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FIgurt  4.  A  graphic  depletion  of  dliaggregatlon. 

Dliafgragatloni  Allowi  for  the  collection  of  leveral  vorticoi  Into  onu  vortex  which 
then  occupies  the  disaggregated  vertices  places  In  the  original  0 
and  contains  the  disaggregated  vertices  as  an  embedded  0  In  the 
new  vortex.  The  reorganising  leaves  the  overall  probability  rela¬ 
tionships  Intact  while  representing  tho  disaggregated  vortices  ns 
conditional  probabilities. 

iixampieS.S  blsaggregation 


tilvon  the  Nituatlon  as  dcscribud  In  figure  4,  disaggregato  the  vertices  A  and  l''lrNl, 
a  trlangulatlon  must  bo  porforiuod  between  A  and  C\  the  dlredlDn  of  IrliuiKuInllun 
Is  of  no  consequence. 

'IVIangulate  from  A  to  C  giving  s  ■  <e  • 


I  ■ 


/»(C)’ 


£idi, 


m 

p{0) 


0 


p{p) 


I  (i + •) 


Nolo;  The  original  connections  and  arc  directions  doterinino  how  llio  arc  weigbls  nre  com¬ 
bined.  However,  the  differences  are  Just  a  matter  of  Inverting  the  weights  ns  needed. 
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FIguro  5.  Simple  application  of  llayoH*  tltcnriMn  uulng  a  prnliability  ratio  {^rnplt  compuictl 
with  tables. 
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S,!,9  Bayttian  inferanet  With  tho forgoing  tooli  for  repreaantlng  and  manipulating 
probablllttu,  an  example  of  Bayealan  inference  la  poaalble.  Figure  5  la  a  simple  example  of 
a  Bayealan  cycle  ualng  probability  ratio  grapha  with  the  correapondlng  tabular  state.  Tho 
example  In  figure  5  ahowa  that  the  0  traneltlona  through  three  different  conflguratlons! 
1)  Prlor-~LlkeUhood  configuration,  2)  Joint  configuration,  and  3)  Prepoiterlor— Posterior 
configuration. 

9,t,4  VtUity  repraaenfolfon  The  utility  representation  followa  the  same  path  as 
the  hypotheses-ovidence  representation.  Instead  of  conditional  probabilities  (likelihoods), 
I  we  have  conditional  utilities,  U{Ak  \  which  represent  tho  utility  of  per* 
forming  action  Ai,  given  that  Hypotheses  'Hi  has  occurred,  Tho  process  Is  exactly  tho 
same,  except  that  Instead  of  tho  posterior  probabilities,  we  are  now  after  the  propostorlor 
utility  Information. 


Figure  0.  Utility  ratio  graph  roprosonlatlun, 

With  the  utility  ratio  graph,  the  same  Intorprvtallons  are  applliul  lu  difrorc'iit  In¬ 
formation.  The  “prior"  liiformatlon  Is  a  scaling  factor  botwoim  the  Isolatud  cundltloiuil 
utility  Information.  Figure  ti  shows  that  tho  coiulltlnnnl  ulllltlos  fur  U(A\  |  K|)  »  10  niid 
V{A\  I  Hi)  n  10,  and  that  tho  scaling  factor  between  K|  and  Hi  Is  This  informnlloii 
states  that  performing  A\  If  Hi  has  occurred  la  worth  twice  na  much  as  performing  If 
Hi  has  occurred,  because  U{Ai,H\)  «  10  while  U(A\iHi)  m  20. 
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9.1,6  Combining  probabililg  with  utility  Combining  the  probability  and  utility  in¬ 
formation  take!  place  with  the  poiterior  probabllltieit  PiHt  |  and  the  utility  Healing 
factori,  The  poiterior  probabilitiea  are  multiplied  with  their  respective  scaling 

factors  and  the  utility  ratio  graph  is  manipulated  to  produce  the  utility  information  con¬ 
ditioned  on  the  state  of  evidence,  U(Ak  \  Mathematically,  this  process  is  similar  to 
the  law  of  total  probability: 

I  ej)  •  E  ''(■<»  I  «i)  • I  (i) 


Figure  7.  Indupondonco  rupresontntion  with  ratio  graphs. 

9.9  Independent  evidence 

According  to  the  description  of  probability  ratio  graphs,  the  vorilcim  of  a  graph 
represent  disjoint  events.  This  extends  to  the  evidence  states  that  are  contained  In  a 
hypotheses  vortex  as  well,  Requiring  cnumerntion  of  disjoint  evidence  states  brings  com- 
blnatorlal  explosion  with  independent  evidences.  The  number  of  disjoint  evidence  states 
grows  exponentially  (2")  with  the  number  of  independent  evidences.  This  Is  clearly  an 
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undesirable  situation  and  combating  this  exponential  growth  requires  a  “tweak”  in  the 
probability  ratio  graph  concept. 

Representing  independence  in  a  probability  ratio  graph  requires  separate  graphs. 
In  Morlan's  description,  he  does  not  allow  for  the  possibility  of  multiple  (disconnected) 
embedded  graphs,  however,  this  addition  to  the  concept  Is  a  natural  outgrowth  of  inde¬ 
pendence.  Figure  7  is  a  depiction  of  two  independent  probability  ratio  graphs  transitioning 
Into  their  Joint  representation.  The  mathematics  of  probability  ratio  graphs  treat  the  vor¬ 
tices  in  a  connected  graph  as  disjoint,  collectively  exhaustive  states.  The  scml-complcx 
graph  in  figure  7  also  treats  each  separate  graph  in  this  way. 


Figure  8.  Joint  occurrence  of  indcpondenl  events. 

There  are  two  ways  in  which  to  use  Indopendont  evidence  for  developing  lliu  posturlur 
distribution  using  probability  ratio  graphs.  One  method  uses  the  nesting  approach  shown 
in  figure  8,  the  other  Involves  sequential  probability  updating.  The  first  method  is  the 
same  as  combining  the  independent  likelihoods  then  applying  Dayes*  theorem.  Sequential 
probability  updating  Involves  using  the  posterior  probabilities  to  replace  tlio  priors  and 
continuing  the  inference  process.  If  the  evidence  states  are  indopendont  then  performing 
sequential  updating  will  produce  an  equivalent  result  to  using  the  disjoint  ovldonce  state 
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and  performing  the  Inference  step  once.  Both  methods  apply  only  when  the  evidences  are 
independent. 


Figure  0.  Nesting  independent  events. 

The  independence  representation  described  requires  support  which  Is  not  supplied 
by  Morlan's  initial  concept.  To  represent  independence,  vertices  must  be  able  to  have 
multiple  embedded  graphs.  This  is  an  easy  step  to  Implement,  it  is  merely  a  redefinition 
to  Include  the  possibility  for  multiple  embedded  graphs: 

Vertex!  An  event  and  embedded  probability  ratio  graphs.  The  event  could 
bo  a  hypotheses  representing  a  possible  state  of  tlio  world  or  a  pos¬ 
sible  evidence  state  which  is  used  to  reason  about  the  hypotheses. 

An  embedded  (I  represents  conditional  probabilities,  conditioned 
on  the  parent  vertex.  Multiple  Cl*s  represent  Independent  event 
states. 

Supporting  the  mathematics  associated  with  Independence  is  more  involved.  A  "nest¬ 
ing”  procedure  needs  to  be  added  to  triangulatlon,  aggregation,  and  disaggregation.  And 
aggregation  needs  to  be  enhanced  to  account  for  the  propagation,  or  ropllcatlon  of  tlie 
remaining  independent  graphs  in  the  aggregated  graph.  A  possible  nesting  procedure  is 
depicted  in  figure  9. 
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9,S  Current  Software 

The  software  developed  for  this  work  Is  generally  an  Implementation  of  Morlan's 
probability  ratio  graph  concept  on  a  small  scale  (It  does  not  include  the  independence 
capability).  It  can  support  the  simple  probability  functions  of  representing  conditional 
and  Joint  probabilities,  and  can  accomplish  Bayes*  theorem  manipulations.  The  simple 
features  can  also  represent  quite  complex  systems  if  a  nested^  approach  is  used.  Vortices 
on  any  level  can  conttdn  embedded  graphs.  Using  this  approach,  the  graph  Is  basically  a 
tree  representation  as  shown  in  figure  10.  The  software  limits  the  total  number  of  vertices 
that  can  be  active**  at  any  one  time,  but  conceptually  there  is  no  limit  to  the  possible 
number  of  levels. 


Figure  10.  Comparison  of  a  compound  vortex  to  a  tree  roprosonlatlon. 


The  software  divides  the  screen  in  four  separate  vicwjwrtu,  each  viewport  supporting 
different  aspects  of  the  program.  Figure  11  shows  n  typical  screen  with  tlio  four  vlowijorts 
(clockwise  from  the  top  left  corner):  viewport  I,  the  prompting  port  for  Input;  viewport 
2,  the  menu  port;  viewport  4,  results  port  for  typed  output;  and  viewport  11,  the  graphics 

^"Neated"  In  this  context  refers  to  tlie  multiple  layers  of  graphs,  not  multiple  graplis  in  a  singlo  layer. 
*In  this  context  “active”  means  all  of  the  vertices  which  are  spocineil  at  all  levels  In  the  system. 
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port,  The  program  can  present  a  vortex  in  two  ways;  1)  as  a  large  pie  graph  which  shows 
the  relative  probabilities  of  each  embedded  vertex  as  the  angle  subtended  in  the  chart,  or 
2)  as  a  small  pie  chart  in  the  corner  of  the  the  graphics  screen  and  ivs  embedded  graph 
shown  as  a  connected  graph  with  each  embedded  vertex  shown  as  a  pie  chart  of  its  likewise 
embedded  graph.  The  net  representation  presents  all  the  available  information  In  a  simple 
probability  problem  showing  two  complete  levels  and  their  relative  proportions  at  once. 


viewport-1 


vlowport-2 


Figure  11.  Net  presentation  of  a  compound  vertex. 

The  software  has  strayed  from  MoHan’s  description  in  several  areas.  The  triangu¬ 
lation  function  has  been  extended  so  that  any  two  vertices  in  a  common  graph  can  be 
connected  regardless  of  their  current  connection  path'^.  If  two  previously  linked  nodes  are 
triangulated  it  either  has  no  effect  or  it  reverses  the  arc  direction,  the  outcome  of  which 
depen  is  on  the  original  arc  orientation  with  respect  to  the  new  arc  orientation.  The  aggre¬ 
gation  function  is  “hot-wired’*  in  that  it  figures  the  probabilities  for  the  aggregated  grapli 


‘Thli  Qxtension  equivalently  triangulates  between  the  vertices  along  the  connection  path. 
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and  uses  their  probability  measure  to  reconnect  the  vertices  on  the  now  level,  Appendix 
A  contains  a  discussion  of  the  program’s  abilities,  limitations,  and  use. 

S.4  ■^ummary 

This  chapter  introduced  an  interpretation  of  Morlan’s  probability  ratio  graphs  with 
possible  enhancements.  It  also  briefly  introduced  the  PC-based  tool  that  implements  the 
probability  ratio  graph  concept  on  a  restricted  level. 

The  addition  of  the  independence  enhancement  will  Increase  probability  ratio  graph's 
versatility  and  ability  to  represent  complex  decision  problems.  The  current  program  is  still 
very  devlopmentally  oriented.  It  would  ,  no  doubt,  benefit  from  code  simplification  and 
technical  modifications. 
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IV.  Mining  Information,  Indepondenct,  and  Stcondary  Uncertainty 


During  8oftWM«  generation  leveral  intereiting  topici  aroie  that  (pawned  quertlona 
of  interpretation. 

e  When  eyitem  parametera  are  unapecifledi  how  ahould  a  diagnoatic  ayatem  deai  with 
the  miaaing  information? 

A  related  queatlon  ia,  how  doea  the  difference  between  cauaal  implication  and  condi> 
tional  probability  affect  likeliliood  generation? 

e  Under  the  common  aaaumptlon  of  diajoint  hypotheaea,  what  doea  hypotheala-evidonco 
independence  mean? 

e  What  la  the  meaning  of  apurloua  evidence,  and  how  doea  it  effect  tlie  diagnoatic 
ayatem? 

The  dealgn  heurlatlca  of  declaion  aupport  ayatema  depend  in  part  on  the  Intorpreta* 
tlona  that  reault  from  theae  conaideratlona.  If  the  information  doacrlbod  above  la  eatlmatod 
it  ia  Important  to  underatand  the  Impact  of  the  original  parametera  ao  Ita  effect  can  be 
taken  Into  account  in  the  eatlmation. 

4,1  Misting  information 

Morlan  points  out  that  during  system  development,  “it  cannot  be  guaranteed  that  all 
combinations  of  evidence  will  be  generated  for  all  hypotheaea."  (13;11)  Umior  this  altuation 
the  problem  la  how  to  continue  the  decision  process  when  pertinent  information  la  avnllnble 
but  how  it  relates  to  some  of  the  hypotheses  under  consideration  ia  unknown.  Clearly  It 
is  desirable  to  include  all  the  available  information  as  long  aa  It  ia  not  a  detriment  to  the 
decision  process.  The  intent  of  this  discuaalon  ia  not  to  prove  that  a  method  la  correct,  but 
merely  to  present  a  proposed  method  and  its  intuitive  interpretation. 

Morlan  presents  a  method  wherein  the  missing  evidence-hypotheses  information  Is 
estimated  under  the  assumption  of  probabilistic  Independence. 

P(e  1  K)  a  P(£) 
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Thil  dou  not  mean  there  is  no  causal  link  between  H  and  £\  in  fact,  It  implies  that  there 
Is  a  causal  link  between  the  two  (see  the  section  on  Independence  for  a  discussion  of  this 
fhcet). 

Another  Interpretation  Is  that  the  lack  of  Information  Implies  that  H  and  S  are 
causally  Independent.  This  may  be  the  case,  but  such  an  Msumptlon  has  a  potentially 
drastic  effect  on  the  posterior  distribution.  If  the  causality  between  H  and  £  Is  truly 
unknown  then  an  assumption  of  no  link  Is  a  bold  move. 

Under  the  assumption  of  probabilistic  Independence,  Morlan  starts  with  the  law  of 
total  probability  to  develop  an  equation  for  determining  the  missing  Information.  Fbr  a 
case  Involving  three  hypotheses,  with  no  Information  for  P[£  \  7ti),  estimate! 

P^e  I «.) . 

1  - 

By  using  this  assumption  the  posterior  probability  PiHx  \  £)  equals  the  prior  prob> 
ability  PiHi)  and  the  posterior  probabilities  for  the  other  hypotheses  change  (unless  they 
too  are  probabilistically  Independent).  In  effect,  the  observance  of  E  alters  those  hypothe* 
ses  which  have  Information  relating  to  £  and  doss  not  affect  the  others.  Figure  13  shows 
a  graphic  Interpretation  of  such  a  process. 

Such  an  operation  can  bo  soon  as  partitioning  the  hypotheses  Into  two  sets;  one  set, 
Hindi  containing  the  hypotheses  which  are  probabilistically  Independent  of  f ,  and  one  sot, 
Hd*pi  containing  the  hypotheses  which  are  probabilistically  dependent  on  £>  Figure  Hi 
shows  such  a  partitioning.  The  probability  conditioning  takes  place  on  the  dependent  set, 
Hd*p  as  If  It  were  the  entire  hypotheses  space.  Then  the  two  sots  are  rocoinblned  to  provide 
the  final  posterior  distribution,  P{Hi  |  £), 

The  process  can  bo  performed  In  this  manner  without  actually  generating  any  missing 
Information  and  the  results  are  equivalent. 
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Flgun  12.  Qraphlc  dipletlon  of  «itlinulng  mining  Informnllou  u  probnblUitlcally  hide* 
pondtnt. 


Exampli  4.1 


Milling  Information 


Qlvin  the  following  Information, 

Prion 

LIkelllioodi 

nnx)  - 

.3 

P{£\nx)  m  (n 

Pm  - 

.4 

f'fa'lH,)  »  .6 

Pm  « 

.2 

/"(flHi)  -  .0 

Pm  - 

.1 

Pie  {Hi)  m  .2 

■  ,020 

Aiiumlng  S  and  Hx  are  probablllitically  indopondont,  |  Hi)  «  ,620.  Apply* 
Ing  Qayei'  theorem  to  the  data  yields  the  following  posterior  probabilities, 

P{Hx  I  £)  «  .3 
P{H%  I C)  -  .382 
P(Ha  K)  «  .286 
P{Hi  I  £)  m  .032 
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FIgurt  13.  Qr&phic  dtpictlon  of  applying  £  by  partitioning  hypotheioi  with  roipoct  to 
probablllitlc  dspindanca. 


Uilng  th«  partitioning  mothod,  nayoi*  thoorem  li  applied  only  to  tho  hypolhnioii 
that  are  connected  to  £, 


Prior* 

Likelihood* 

PiHi)  *  .4 

PieiHi)  -  .0 

PiHii)  «  .2 

p{e\H,)  -  ,0 

P{Hi)  *  .1 

Pisin^)  -  ,2 

Thli  dell  von  the  Intorinodlato  pontorlore, 

PiHi  I  f)'  ■  .845 
P(«3  I  £)'  "  .400 
PiHi  IF)'-  .048 

Rocombinatlon  of  the  Indepondont  hypothcaos,  Hind^  with  the  dnpondonl  hypotho. 
■OR,  Hdip*  Involvoa  acalliig  the  Intorinodlato  poatorlora  with  roapoct  to  Ihulr  prior 
prohabllltlea. 
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FIgura  14.  Qraphlc  dtplct.lon  of  applying  £  by  partitioning  hypothoioi  with  roiport  tu 
probablliitic  dapendonce  (continued). 


m  .'l+.'i-f.l 

•I  .T 

Giving  the  name  poatorinr  dlotribution  aa  tho  flrat  motiiod. 

P{Hi  I  f)  -  .3 

P(«a  if)«(.64a).(.7;»  .382 
W3if)-(.400).(.T)-.286 
/>(«4  |f)i(.043).(.7)«  .032 

Thla  example  ahowa  the  intuitive  appeal  of  Mauinlng  prubablllalic  Indupuiuluuoe  wIicmi 
likelihood  information  li  mlaaing  and  there  are  no  grounda  for  making  a  lubjective  aaauaa- 
ment.  It  aeema  beneficial  to  Include  Information  when  ita  availability  can  aurvc  to  dlfroren- 
tlate  between  acme  of  tho  competing  hypothoaea,  At  tho  aamo  time,  It  would  aoem  folly  to 
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sxcludt  hypothmu  Juit  btcauie  tha  connecUona  aro  unknown  or  not  under«luud‘,  UhIiih 
th«  Miumptlon  of  probnblllatic  Indepondanca,  m  preaentod  by  MorUnt  aoema  to  bidance 
the  ntad  to  Include  the  evelUble  Information  without  treating  the  apparently  underdeDned 
hypotheaea  unfairly. 

4,9  LiktHhoodi 

The  relatlonahip  between  hypotheaea  and  evidence  la  confbaed  by  the  perceived  equal¬ 
ity  of  cauaallty  with  conditional  probability.  Only  under  highly  conatralned  condltlona  li 
P(e  I H)^  the  conditional  probability,  aynonymoua  with  P{€  |«  H)^  the  cauaal  probability^, 
(‘‘lo”  Indleatea  mumi/  probability,  not  eondfli'one/ probability).  ThU  diflbronco  cauioa  prob- 
loma  In  ayatein  development  becauaa  In  many  altuatlona  It  la  euler  to  think  of  and  eatlmato 
the  probability  that  H  cauaed  f ,  P{€  |e  X),  than  It  la  to  eatlmate  the  likelihood,  P{£  \  X)^. 
However,  It  la  the  llkellhooda  that  are  uaed  In  Dayealan  Inference,  not  the  cauaal  Impll- 
catlona.  Generating  mlaalng  likelihood  Information  bringa  out  the  Important  dlfToruncu 
between  conditional  probability  and  cauaal  Implication. 

The  conditional  probability,  P{€  |  X),  la  Information  that  li  uiually  aupplled  through 
atatlitical  analyala  or  expert  opinion.  However,  In  the  event  that  either  the  exlatlng  data 
bue  la  InaufHclent  for  valid  atatlatlcal  reaulta,  or  the  expert  can,  at  boat,  aupply  cauaal 
Impllcatloni,  then  llkellhooda  muat  be  eatliuated.  The  likelihood  P{S  \  X)  la  equal  to  the 
probability  that  X  cauaed  (  plua  the  probability  that  C  happonod  Independently  of  X 
given  that  X  did  not  cauae  £, 


FIgurt  IS,  Venn  dtagr&m  for  exampU  4.3. 


W|Ki)  ■ 

Wl«s)  •  wJfftfi. 

However,  the  cauial  probabilltloi,  oitlmatad  by  an  export,  are  lomuthlng  other  than 
the  condItlonalH! 

'XTBhjys  s  Pi^WXi)  s 

is^iAiJvr  ^ 

The  problem  arioee  from  the  fact  that  P{£  |a  Hx)  and  P{£  |e  Hi)  are  known, 
while  the  conditional  probabllltlei  (the  regloni  In  the  Venn  diagram)  are  unknown. 
Without  eome  further  Information  on  roglone  A  and  C  there  U  no  way  of  generating 
the  conditional  probabllltlei. 

A  poiilble  limpllfylng  aiiumptlon  in  that  regloni  B  and  D  are  equal  to  the  empty 
let.  Thli  li  the  baiic  aiiumptlon  of  dlijoint  hypotheiei.  Ai  long  ai  E  can  only  be 
cauied  by  the  hypotheiei  under  conilderatlon  (thli  impllei  that  G  li  alio  equal  to 
the  empty  lot),  then  the  conditional  probabllltlei  and  the  cauial  prubabllltloi  are 
equal: 

p{e\n,)  .  neioWi)  -  tit 

P{e\H,)  -  f(«|,K,)  .  rjp 
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Thti  ilmpllfying  Aiiumptlon  hM  tome  appeal.  However,  adding  apurloui  evidence 
to  the  model  U  actually  laying  that  there  la  a  hypotheala,  that  la  Independent  of  the 
let  of  hypotheaea  of  Intereat,  which  could  cauae  B,  In  thia  caae  the  problem  becomoa 
difficult  to  viaualiie  with  a  almple  Venn  diagram. 

In  moat  altuatlona  there  la  aome  probability  that  an  evidence  can  occur  without  being 
cauied  by  one  of  the  hypotheaea  under  conaideratlon.  Thia  probability  of  independent  or> 
currence  inertuea  the  conditional  probabllltiea  and  doea  not  affect  the  cauaal  probabilitlea. 
The  problem  of  dealing  with  cauaal  eatlmatei  when  uilng  a  frequency  Inference  meclianlim 
la  Important  and  not  trivial, 

4,S  Indtptndtnet 

In  aDayeilan  diagnoatic  ayatam  when  an  evidence  and  hypotheala  are  probablllatlcally 
Independent  it  la  generally  true  that  they  are  cauaally  dependent.  The  only  way  C  and 
a  member  of  the  diajoint  hypotheaea  aet,  Hg,  can  bo  both  probablllatlcally  and  cauaally 
Independent  la  if  every  member  of  la  cauially  Independent  of  (,  In  auch  a  altuatlon  C 
la  of  no  value  aa  evidence  alnce  It  doea  not  differentiate  between  the  poaalble  hypotheaea. 

Another  way  that  a  member  of  Ht  and  £  can  be  probablllatlcally  Independent  la  If 
the  P(£  I  H)  happen!  to  equal  the  P{£)  aa  given  from  the  law  of  total  probability! 

P{C)m'£P{e\'H,)Pm 

im\ 


Where  Hi  are  mombera  of  Hg, 

In  auch  a  altuatlon,  probablllatlc  Independence  la  an  Intureallng  prupurly  but  la  of 
little  actual  algnlflcance,  The  Intureating  property  la  that  If  H  and  £  are  probablllatlcally 
Independent  then  obaervlng  £  doea  not  alter  the  probability  that  H  haa  occurred.  It  la 
of  no  real  algnlflcance  becauie,  aa  Morlan  polnta  out,  'Hhe  Important  Information  In  a 
altuatlon  Includea  the  relative  probabllltiea  of  the  poaalble  atatea  of  the  world  and  the 
relative  loaiea.  Declalona  between  two  actlona  can  bo  made  baaed  on  a  computation  of  the 
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relative  expected  loiiei.**  (13:3)  So,  In  a  deciiton  eltuatlon  tho  relative  probabilities  of  the 
hypotheiei  are  Important  not  their  actual  probabllltlei. 

4>4  •Vecondary  l/neetiainly 

The  term  apun'ouf  came  up  quite  often,  moatly  In  conjunction  with  arguments  about 
Independence,  Spurious  is  a  vague  term  which  can  encompass  a  broad  range  of  phenomena. 
According  to  the  dictionary  spurious  means  false;  however,  in  some  situations  It  Is  applied 
where  It  refers  to  various  Ideas;  unknown  origin,  unimportant  origin,  and  false  Indication. 
The  first  two  Ideas,  unknown  and  unimportant  origin,  apply  when  the  event  actually 
occurred  but  why  It  occurred  Is  either  unknown  or  unimportant.  Tho  last  idea,  falso 
Indication,  applies  when  the  Indicated  event  hasn't  actually  occurred.  False  Indication 
can  happen  In  two  ways;  first,  an  Indication  of  an  event  that  hasn’t  actually  occurred, 
and  second,  lack  of  an  Indication  when  an  event  has  occurred.  This  false  Indication  Is 
a  reporting  problem,  and  Its  probability  assessment  Is  the  uncertainty  In  the  evidence  or 
secondary  uncertainty, 

FUse  Indication  can  bo  characterised  as  the  observance  of  some  ovent  when  the  event 
hasn't  occurred.  The  probability  of  such  an  observance  Is  stated  as  the  |  nolC)  and 
P(no(l?o  I  ^)i  or  P{£  |  noffg)  and  P(not£  |  £«),  where  £„  Is  the  observed  state  and  £ 
Is  the  actual  state.  The  confldonco  (uncertainty)  In  tho  obsr  ved  data  Is  the  probability 
that  the  observed  state  Is  the  same  as  the  actual  state:  P(£o  |  £)  and  P(rwt£o  |  notS), 
or  P(€  I  £«)  and  P(not£  |  no(£o).  What  wo  see  and  can  gather  Is  tho  observed  state,  £« 
and  our  decisions  are  based  upon  observed  Information.  Whether  the  assessment  of  tho 
uncertainty  Is  described  as  P(£  |  £g)  or  P(£o  |  £),  the  goal  Is  an  assessment  of  tho  posterior 
probability  PCH^  |  £o),  where  Ht  are  the  hypotheses  under  consldt'ialion. 

There  are  at  least  two  possible  methods  for  Incorporating  secondary  uncertainty  in 
a  probabilistic  Inference  problem;  1)  Jeffrey's  rule,  which  uses  the  assosNinont  of  P{£  |  £(,)• 
and  Incorporatos  this  Information  at  tho  posterior  level;  and  2)  an  alternate  method,  which 
Involves  tho  assessments  of  P(£o  |  £)  and  P(notSo  |  not£),  and  Incorporates  this  Infurma- 
tlon  at  the  likelihood  level.  Both  methods  perform  the  same  type  of  mathematical  trans- 
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formation;  however,  there  are  potentially  great  differences  in  the  computational  complexity 
of  a  given  problem. 

4,4>  i  Jeffrey ‘t  rule  Jeffrey’s  rule  Is  a  method  for  generating  the  probabilities  P{Hi  \ 
So)  when  the  uncertainty  aisessment  yields  P(S  |  S^),  It  is  an  application  of  the  law  of 
total  probability  conditioned  with  the  confidence  In  the  report,  P(S  \  Sn). 

(a) 

Equation  2  Is  a  weighted  average  of  the  possible  probability  states  P('H  |  S)  and  P(7i  | 
notS)^  weighted  on  the  uncertainty  In  the  evidence  state  £,  Graphically,  Jeffrey’s  rule  is 
limply  a  linear  Interpolation  between  the  possible  pure  evidence  states  weighted  with  the 
uncertainty  in  the  evidence  states. 


Jafflray’i  Rula  with  I  Evidanoi 


Exampla  4.8 


Given  the  following  probabilities. 


P{n  I  S) 
Pin  I  notS) 


With  the  conUdoiico  In  S  at  80%, 


.2 

.8 


Pi£\So)«S 

then  the  posterior  probability  of  H  given  the  observed  evidence  £„  becomes, 

P{n\£o)  B  P{n\£)Pi€\eo)  +  P{n\note)P{not£\£o) 

-  (.2)(.8)  +  (.8)(.2) 

m  ,32 


This  example  is  graphically  depicted  In  figure  16. 
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Figure  16.  Graphic  depiction  of  Jeffrey*!  rule. 


If  there  are  leveral  evidence  itatei,  the  result  Is  the  Intersection  of  the  Interpolations 
conditioned  on  the  evidences  in  question. 


ITxample  4.4  J«Wirey*s  Rule  witli  2  Evidences 


In  this  example  there  are  two  evidences,  each  with  some  degree  of  uncertainty.  Given 
the  evidence  £\  is  the  evidence  from  example  4.3,  and  the  following  probabilities, 

P{n\£x,£i)  =  .9 

P{n\£x,not£’i)  =  .2 

P(Wi  nof£i,£a)  s  .4 
P(W  I  not£i,nof£a)  =  .8 

With  the  confidence  In  €\  at  80%,  and  in  at  30%, 

TOKo)  «  .8 

P{e’i\e,)  «  .3 

with  above  Information  the  assessment  of  the  posterior  probability  of  ‘H  given 
the  observed  state  of  the  evidence,  becomes, 
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Figure  17.  Graphic  depiction  of  Jeffrey's  rule  with  uncertainty  In  two  ovIdcncvH. 


p{H\€o)  «  P(n\eu£2)P{ei\eo)Pie2\eo) 

+  P{H  1  €unot£2)P{ei  I  £o)P{not£2  \  Co) 

+  P(W  I  fiot£i,£3)P(not£i  |  £o)P(^3 1  ^o) 

+  P("H  i  not£i,not£3)P(not£i  |  €o)P(uolCi  \  £„) 

«  (.0)(.8)(.3)  +  (.2)(.8)(.7)  +  (.'l)(.2)(.3)  +  (.8)(.2)(,7) 

a  ,464 

This  example  is  graphically  depicted  in  figure  17.  The  value  of  at  ouch  corner 
of  the  graph  is  the  “pure"  posterior,  conditioned  on  a  combination  of  perfect 
information  about  the  evidences. 

4.4>i  Spurious  Evidence  Another  method  for  Incorporating  uncertainty  In  the  ev¬ 
idence  is  to  use  the  assessment  of  the  P{£o  \  £)  to  generate  now  llkolihuod  probabtlllies 
P{£o  I  H),  Like  Jeffrey's  rule,  it  is  an  application  of  the  law  of  total  probability.  It  involves 


conditioning  on  the  confidence  in  the  reporting  system,  P{£o  |  f). 


P(£«)  s  P(f,  I  S)P{e)  +  PiSo  I  note)P{notS)  (3) 

The  effect  of  incorporating  the  uncertainty  in  the  evidence  In  the  likelihoods  is  to  reduce 
the  range  of  values  that  the  likelihood  P{€o  \  H)  can  take, 


Figure  18.  The  effect  of  spurious  evidence  on  likelihoods. 

Example  4.5  Unsymeteric  Spurious  Evidence 


Given  that  the  probabilities  for  observing  £  are, 

P{£o  I  £)  =  .9 

P{£o  I  noi£)  a  .3 

and  If  the  likelihoods  are, 

Pi£\Hi)  =  .8 
P{£  I  notHi)  a  .4 

then  by  applying  equation  3  the  likelihoods  for  the  observed  evidence  become, 

PiSolHi)  =  .78 
P{£o  I  notHi)  =  .54 


4* 


In  this  example,  the  range  of  the  observed  likelihoods,  P{So  \  Hi),  Is  between 
.9  and  .3.  Figure  18  depicts  the  range  of  values  that  P(Bo  I  H)  can  take.  The 
P(£e  I H)  will  lie  somewhere  along  the  line  depicted  in  figure  18, 

Equation  3,  when  expressed  in  terms  of  the  probability  of  seeing  the  correct  atato  of 
the  evidence,  changes  to, 

P(f,)  a  P(e)  [P(£o  I  B)  +  P(notBo  I  notB)  -  1]  +  1  -  PinotB^  \  notB)  (4) 

If  the  spurious  nature  of  the  sensor  is  independent  of  the  sensor's  actual  state  then 
P{Bo  I  B)  =  P{noiBo  I  notB),  and  Is  aymmttric.  When  the  probability  of  error  Is  sym¬ 
metric,  equation  4  reduces  to, 

P{Bo)  -  P{B)[2P{B,  \B)-1]  +  1-  P{Bo  I  £)  (6) 


i’(fo  1  Hi) 

P{£o  I  £) 


Figure  19.  The  effect  of  symmetric  spurious  evidence  on  likelihoods. 
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Given  the  probabilities  from  example  4.5  except  that  the  spurious  probabilities  are 
symmetric,  and  equal  to, 

P(£,  I  S)  m  P{noiSo  I  notS)  m  .8 

then  the  likelihoods  for  the  observed  evidence  become, 

P{So  1  =  .68 

P(e»  I  ttotnO  m  .44 

This  example  Is  graphically  depicted  In  figure  19. 


The  worst  situation  would  be  to  have  the  P(£o  |  S)  »  P(notSo  |  noi£)  m  0.5.  ThU, 
in  effect,  is  a  random  sensor  with  a  uniform  distribution  over  the  possible  states.  In  sucK 
a  case  the  P(£o  |  U)  ■  0.5,  regardless  of  the  P(£  |  7i);  this  case  Is  depicted  In  figure  20. 
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4.4>^  Compariion$  Doth  mothodi  ostlmate  th«  P(7i  |  £«).  However,  they  go  about 
it  In  different  wayi.  With  Jeffrey’i  rule  the  conditioning  takei  place  after  applying  Bayes' 
theorem  using  the  P{S  \  €«)  and  P(not£  \  St),  and  the  posterior  probabilities  P(7f  |  S) 
and  P{H  \  notS)i 

Pi'H  I  fo)  -  E  P(W  I  ei)Pi£i  I  St)  +  P(W  I  noiSi)P{notEi  \  St) 

imi 

in  the  other  method  the  conditioning  takes  place  before  applying  Bayes*  theorem 
using  the  P(Sa  \  S)  and  P(€t  \  notS),  and  the  likelihoods  P{S  |  Hi)  and  P{notS  \  Hi)\ 

P{St  I  W)  -  PiSt  1  S)P{S  I H)  +  P{St  \  noi£)P{notS  \  H) 

Since  both  methods  are  concerned  with  estlmatingthe  same  posterior  probability  P{H  |  So)) 
(by  conjecture)  they  should  arrive  at  the  same  conclusion  given  compatible  Initial  conditions'*. 
However,  because  the  methods  Include  the  evidence  uncertainty  Information  at  different 
levels  in  the  Bayesian  inference  process  the  number  of  assessments  and  calculations  required 
Is  different. 

Examples  4.3  and  4.4  show  the  effect  of  applying  Jeffrey's  rule.  The  posterior  proba¬ 
bilities  for  every  combination  of  the  set  of  evidences,  S„  are  needed  to  make  an  assessment 
of  the  P{H  I  St)>  The  problem  grows  exponentially  with  the  number  of  evidences  under 
consideration,  and  linearly  with  the  number  of  hypotheses.  Example  4,7  is  a  comparison 
of  the  assessments  and  calculations  required  by  JelTrey's  rule  and  the  alternate  method. 


*Det«rmlnlng  compatible  initial  condition!  is  a  formidable  teak  In  itself.  Such  a  determination  involves 
the  use  of  the  marginal  distribution  on  either  or  S. 
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Bxampl*  4.T 


Mnthod  Comparlioni 


Starting  with  an  lnf«r«nc«  problam  that  has  th«  prior  probabllltlsi  PCHO  and  the 
Ukellhoodi  P(£j  |  Tit)  already  speclfled,  how  does  Jefi>ay*i  rule  compare  to  the 
alternate  method  in  assessing  the  posterior  probabilities  P(Tii  |  So)? 


Initial  eondltlonsi  ■  1  to  a 

■  1  to  n 

l&BMi 

InUltflBl 

Conditional  probability  assessments 

n 

usessmenta  of  P{Sj  \  So) 

n 

or 

2>n 

assessments  of  P{So  |  fj)  If  uncertainty  Is  symmetric, 

assessments  If  not  symmetric,  n  assessments  of  P(f,  |  nolSj)^ 
and  n  assessments  of  P{So  \  Sj) 

Posterior  probability  calculations 

HH 

calculations  of  the  posterior  probabilities  P(7f<  |  no(f^), 
and  P(Tii  \  Sj) 

a 

calculations  of  the  posteriors  PiTit  \ 

Conditional  probability  transformations 

a 

calculations  of  the  posterior  transformation 

Pint  1  tf.)  -  2  PiTit  1  ei)P(et  \  |  notef)P{notei  |  e,) 

a  •  n 

calculations  oi*  tlie  likelihood  transformation 

P[£,j  1  Hi)  B  PiSoi  1  1  Tit)  +  P(£oj  1  nof£j)P(nat£j  |  ’«,) 

Table  1.  Comparison  of  Jeffrey’s  rule  with  the  alternate  method. 


Table  1  shows  that  using  Jeffrey’s  rule  for  Incorporating  secondary  uncertainty  grows 
exponentially  In  the  number  of  posterior  probabilities  required.  If  secondary  uncertainty 
can  be  Incorporated  In  the  likelihood  Information,  then  the  Inference  problem  grows  linearly 
with  the  evidences  In  calculating  the  likelihoods,  and  decreases  the  number  of  posterior 
probabilities  to  one  for  each  hypothesis  under  consideration. 
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4,S  Summary 

This  chapter  covered  1)  e  poiilble  method  for  dealing  with  mining  information  to 
continue  with  the  Inference  proceei,  2)  the  difference  between  causal  Implication  and  con> 
dltlonal  probabilities  and  how  It  affects  likelihood  generation,  3}  the  meaning  of  causal 
independence  and  probabilistic  Independence  In  the  context  of  a  Bayesian  Inference  model, 
and  4)  the  effect  of  Including  secondary  uncertainty  In  a  Bayesian  Inference  model. 

The  foregoing  discussion  only  begins  to  show  the  ramlfleatlons  of  each  area.  With 
missing  Information,  the  usumptlon  of  probabilistic  Independence  has  Intuitive  appeal 
and  Is  easily  Implemented.  The  difference  between  causal  Implication  and  conditional 
probability  can  have  significant  effects  In  the  generation  of  the  Initial  probabilities  used  In 
probabilistic  Inference  systems.  The  difference  In  the  meanings  of  causal  and  probabllls* 
tic  Independence  with  respect  to  Bayesian  Inference  systems  Is  an  Important  distinction. 
Causal  Independence  has  an  Intuitive  meaning  where  the  Independent  parties  have  no  con¬ 
nection.  Probabilistic  Independence  Is  an  Interesting  phenomena  but  Is  of  little  use  when 
Interested  In  causality.  Lastly,  where  secondary  uncertainty  Is  Included  has  a  great  effocl 
on  the  computational  complexity  of  probabilistic  systems. 
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V,  Coneluaiona  and  Recommendationa 


lanH  it  aad  how  aome  paoplr  'a  grip  on  their  Uvea  ia  ao  precarioua  that  they*ll 
embrace  any  prepoateroua  deiuaion  rather  than  face  an  oeeaaional  bleak  truth? 

Calvin  and  Hobbu  (comic  strip)  -Bill  Waterion 

This  thssis  wu  concftrned  with  the  ’-epresentatlon  and  Interpretation  of  uncertainty. 
Chapter  11  presented  a  view  of  the  present  state  of  uncertainty  reasoning  from  an  opor* 
atlonal  and  a  philosophical  perspective.  Chapter  III  examined  probability  ratio  grapha  as 
a  representation  of  the  probability  model.  Chapter  IV  discussed  several  topics  of  concern 
In  uncertainty  reasoning:  1)  missing  Information  and  likelihood  generation,  2)  the  mean¬ 
ing  of  Independence  fVom  a  Bayesian  context,  and  3)  Including  secondary  uncertainty  and 
spurious  Indications.  This  research  was  motivated  by  the  current  Interest  In  Incorporating 
uncertainty  reasoning  Into  expert  systems.  The  following  are  the  conclusions  resulting 
f^'om  this  researcli, 

5. 1  Coneluaiona 

Non-uniqueneaa  of  Uncertainty  Repreaentation,  The  representation  of  uncertain 
knowledge  can  take  many  forms,  none  of  which  can  be  said  to  be  an  exclusively  “cor¬ 
rect**  method.  While  operationally  any  method  is  applicable  if  used  within  its  valid  range, 
for  theoretical  acceptance  they  must  be  consistent  and  logically  coherent,  Probability  the¬ 
ory  exhibits  both  characteristics  and  has  a  sound  theoretical  foundation  while  the  other 
methods  do  not.  This  does  not  preclude  research  Into  the  other  methods;  however.  It  does 
show  that  they  have  limited  applicability  as  they  now  stand. 

Probability  Ratio  Grapha  as  a  Repreaentation  of  Probability,  Probability  ratio  graphs 
are  an  appealing  method  for  representing  the  probability  model.  It  Is  easily  rendered  In 
a  graphical  format  where  conditional  and  marginal  probabilities  are  readily  evident  and 
are  Intuitively  meaningful.  As  Morian  describes  them,  probability  ratio  graphs  cannot 
represent  probabilistic  Independence.  The  proposed  method  for  adding  an  Independence 
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c&pabillty  enhance!  probability  ratio  graph*!  ability  to  represent  the  probability  model, 
and  therefore  Increase!  their  versatility  for  representing  complex  decision  problems, 

Mining  Information  and  likelihood  Generation,  The  method  of  assuming  proba* 
blllstlc  Independence  for  generating  missing  likelihood  Information  offers  several  benefits: 
1)  It  hu  an  Intuitive  appeal  since  It  seems  beneficial  to  Include  all  the  available  relevant 
Information  In  a  given  decision  problem,  2)  It  appears  detrimental  to  the  decision  problem 
to  exclude  hypotheses  through  Ignorance,  3)  Morlan*s  assumption  of  probabilistic  Indepen¬ 
dence  seems  to  balance  the  need  for  Including  available  Information  while  not  excluding 
hypotheses  through  Ignorance,  and  4)  It  obviates  the  need  to  generate  any  information 
since  applying  Bayes*  theorem  to  the  partitioned  dependent  hypotheses  and  recombining 
produces  equivalent  results. 

The  distinction  between  causality  and  conditional  probability  has  ominous  Implica¬ 
tions  when  experts  make  subjective  estimates  of  conditional  probabilities,  Probability  Is  a 
representation  of  relative  frequencies,  not  causality.  This  in  Important  because  In  many  sit¬ 
uations  It  Is  easier  to  think  about  and  estimate  causality  than  it  Is  to  estimate  conditional 
probability.  However,  since  Bayesian  Inference  is  probabilistic,  It  treats  the  Information  as 
relative  frequencies,  not  causality.  If  experts*  subjective  causal  assessments  are  to  be  used 
they  must  be  transformed  from  a  causal  representation  into  a  frequency  representation. 

Cautal  Versus  Probabilietic  Independence.  In  a  Bayesian  Inference  context,  proba¬ 
bilistic  independence  Is  a  coincidence  of  little  significance  to  the  decision  problem.  Causal 
Independence,  on  the  other  hand.  Is  of  great  slgiiincancc  since  It  Is  a  strung  Implication 
when  either  an  evidence  state  Is  present  or  absent. 

Including  Secondary  Uncertainty.  Secondary  uncertainty  Is  a  product  of  the  reporting 
system.  It  Is  termed  secondary  uncertainty  because  It  is  a  characteristic  of  the  ovldoncu 
which  is  used  to  reason  about  the  state  of  the  world.  It  Is  thus  secondary  because  It  is 
not  part  of  the  primary  uncertainty  problem.  Chapter  IV  presents  Jeffrey's  rule  and  an 
alternate  method  for  Including  secondary  uncertainty  In  the  reasoning  process.  Jeffrey's 
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rult  Includvi  th«  tecondary  uncertainty  at  the  poitorlor  level,  whereat  the  alternative  la  to 
include  the  aecondary  uncertainty  at  the  likelihood  level.  In  a  relatively  almple  example,  It 
wai  ahown  that  the  alternate  method,  aa  compared  to  JefTrey’a  rule,  produced  algnlflcant 
reductlona  In  the  computational  complexity  of  Including  aecondary  uncertainty 

5.1  Aftai  for  Puturt  AeaeorcA 

/*r06a6fN(y  Ratio  Qraph  ImpUmantation,  The  probability  ratio  graph  concept  ii 
maturing.  With  the  conceptual  addition  of  Independence  It  haa  become  capable  of  rep* 
reaentlng  the  fhll  probability  model.  The  developed  program  la  capable  of  handling  the 
reatrlcted  probability  ratio  graph  model;  however.  It  la  atlll  a  fledgling  reaoarch  tool  which  la 
not  computationally  efficient.  A  next  atep  would  bo  to  atreamllne  and  almplllV  the  preaent 
coding,  and  Implement  the  full  probability  ratio  graph  concept  Including  the  Independence 
capability  and  the  utility  aoctlon. 

Analytii  of  the  Miaiing  Information  Aatumption  and  Liktlihood  Ceneraffori.  Ap* 
plying  the  aaaumption  of  probablllatic  Independence  to  miaalng  Information  la  Intuitively 
appealing  and  eully  Implemented  from  a  calculation  atandpolnt’.  However,  eaao  of  hnpio* 
mentation  and  being  Intuitively  pleaalng  are  not  vlgoroui  teata  for  validity.  Other  methoda 
ahould  be  developed  and  then  compared  with  thia  aaaumption  to  eatabllsh  a  buala  for 
validity. 

The  generation  of  likelihood  information  'a  related  to  tho  mlasing  Information  prob¬ 
lem.  Aa  preaentod  In  thla  theala,  generating  likelihood  Information  from  cauaal  information 
neceaaltatea  an  analyali  of  the  underlying  doclalon  problem;  apeciflcally,  aaBcaalng  the  pon- 
alblllty  of  the  Independent  occurrence  of  evidence.  Further  reaearch  Involving  the  likelihood 
generation  acheme  preaentod  In  chapter  IV  would  provide  a  greater  undcratandlng  of  the 

‘By  conjoetursi  given  compatible  Initial  conditions  both  msthodi  should  produce  equivalent  results 
since  they  ate  estlmstlng  the  estno  posterior  probability.  However,  determining  those  coiiipstlble  inllUl 
conditions  le  ItieK  a  dlfllcult  undertaking. 

‘‘Under  the  uiuniptlon  of  probabilistic  independence  no  mieeing  information  needs  to  be  generated  to 
continue  the  Inference  process. 
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lubjfctiva  uiuiment  procuiei  and  may  explain  the  Irrationality  of  tome  expert  aaaosa* 
mente  when  they  occur. 

Including  Secondary  UnecHainty,  Including  tecondary  uncertainty  Involves  tratu> 
forming  a  conditional  probability  Involving  the  evidence,  f ,  Into  a  conditional  probability 
involving  the  observed  evidence,  Ai  shown  In  Chapter  IV,  where  In  the  Inference  cy¬ 
cle  this  transformation  occurs  has  a  great  Influence  In  the  computational  complexity  of 
the  overall  problem.  Chapter  IV  only  introduces  the  concept  of  Including  secondary  un¬ 
certainty  In  the  likelihood  Information;  the  preliminary  Indications  are  that  this  method 
greatly  reduces  the  calculations  required  as  compared  with  Jeffrey’s  rule.  It  was  conjec¬ 
tured  that  Jeffrey’s  rule  and  the  alternate  method  should  produce  equivalent  estimates. 
This  conjecture  must  now  be  substantiated  or  disproved  whichever  the  case  may  be. 

8,3  Summary 

Uncertainty  reasoning  has  proven  to  be  fertile  ground  for  creative  minds,  There  li 
always  room  for  further  Interpretation  of  uncertainty  and  how  to  objectively  deal  with 
It.  This  thesis  dealt  with  several  topics  Involving  the  representation  and  Interpretation  of 
various  facets  of  uncertainty.  Further  research  into  the  topics  introduced  In  this  thesis  may 
prove  fruitful  for  using  a  probabilistic  model  of  uncertainty,  However,  probability  Is  only 
one  method  for  representing  uncertainty;  other  methods  may  prove  superior  If  they  can 
solve  the  problems  of  consistency  and  logical  coherence. 
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Appendix  A.  Probability  Ratio  Graph  Softwart 

Thii  appendix  containi  a  dlicuiilon  of  the  probability  ratio  graph  loftware  created  as 
part  of  this  theiii  effort.  Turbo  Pucal  li  the  aupportlng  language  due  to  its  1)  availability, 
2)  graphics  capability,  and  3)  programming  support.  Another  Important  point  Is  that  my 
advisor  was  familiar  with  Turbo  Pucal,  so  help  wu  available.  The  purpose  of  this  software 
Is  to  provide  a  beginning  for  encoding  probability  ratio  graphs.  The  first  section  will  cover 
the  system  structure,  and  the  second  section  will  cover  program  use. 

A,i  Structurt 

Most  of  the  program  is  support  for  Information  management  functions  and  user 
Interfacing.  The  software  Is  separated  Into  five  units,  each  containing  related  functions, 
and  one  driver  program, 


Purpose 

ism 

1 

' 

Ports 

Contains  procedures  for  screen  formatting.  Interfac¬ 
ing,  and  control. 

Parts 

Contains  program  specific  procedures  for  generating, 
loading,  saving,  and  managing  node  and  arc  Informa¬ 
tion. 

Slrow 

Contains  program  speci^c  procedures  for  graphics 
display  and  probability  ratio  graph  manipulations. 

■ 

Note:  '1 
tiate  th 

'he  driver  program  is  “tesl.paa."  Its  only  purpose  Is  to  inU 
e  program  and  hand  over  control  to  the  menu  unit. 

I'able  2.  Program  units  and  their  purpose. 


The  program  uses  record  variables  to  represent  the  two  data  Btructures  Involved  In 
probability  ratio  graphs,  arcs  and  nodes  (the  term  "node**  Is  synonymous  with  “vertex"  for 
purposes  of  discussion.).  The  operations  are  carried  out  by  procedures  (which,  Incidentally, 
do  not  necessarily  go  by  the  same  names  u  described  In  Chapter  111;  the  differences  will 
be  discussed  when  the  need  arises.).  This  discussion  covers  the  general  program  concept 
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and  function.  Th«  Individual  procoduret  are  lilted  In  appendix  6  with  specific  information 
relating  to  there  use  and  purpose. 

A, 1,1  Lit  Unit  The  Lit  unit  contains  procedures  for  manipulating  list  structures. 
Turbo  Pucal  does  not  readily  support  list  structures^  however,  there  are  some  data  itruc* 
tures  In  this  program  which  are  best  represented  with  lists.  The  procedures  in  this  unit 
provide  a  means  for  using  Turbo  Pucal’s  string  variables  as  lists. 

There  are  two  types  of  Hit  structures:  1}  lists  where  the  members  are  separated  by 
commas,  and  2)  lists  where  the  members  are  separated  by  blank  spaces.  The  two  types 
came  about  because  the  ftrit  lists  were  separated  by  commas  and  the  majority  of  the 
program  was  written  toward  that  end;  the  second  Hit  type  was  a  late-comer,  It  grew  from 
a  need  for  displaying  text  In  the  different  screen  viewports  (word  wrapping  in  different 
port  widths,  and  different  screen  modes-EQA,  VGA). 

This  unit  is  Independent  of  the  specific  program  purpose;  that  is,  it  can  be  used  in 
other  applications  where  data  structures  are  represented  as  lists, 

A,l,$  Ports  Unit  The  Ports  unit  contains  procedures  for  screen  formatting  and 
Interfacing.  An  important  part  of  the  program’s  function  is  the  presentation  of  the  in¬ 
formation  contained  in  probability  ratio  graphs,  and  to  provide  for  easy  user  interfacing. 
Like  the  Lit  unit,  this  unit  is  not  program  specific.  The  procedures  can  be  used  with  other 
applications. 

Some  procedures  In  this  unit  provide  the  capability  for  separating  the  screen  into  four 
areas  (viewports),  each  providing  a  means  for  presenting  different  types  of  information^. 
There  are  procedures  that  change  the  active  viewport  and  perform  the  administrative 
overhead  (maintaining  last  cursor  position,  changing  color  settings  to  the  current  viewport 
colors,  etc...). 

’LISP  is  &n  sxsmple  of  s  laniutgo  that  relies  on  lists  for  the  data  structures. 

*There  are  no  procedures  that  speciflcally  control  the  type  of  information  displayed  In  the  dlfferoiit 
viewports.  Any  information  can  be  displayed  In  any  port;  where  the  information  Is  displayed  Is  up  to  the 
proirammei. 
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Several  procedures  control  the  input  and  output  of  typed  information.  These  specific 
procedures  are  necessary  because  Turbo  Pascal  does  not  have  the  capability  for  displaying 
text  and  graphics  windows  simultaneously.  For  presentation  continuity  the  screen  is  In 
the  graphics  mode  at  all  times.  To  provide  for  typed  Interaction,  special  procedures  were 
needed. 

A.l.S  Parti  Unit  The  Parts  unit  contains  the  procedures  that  control  the  creation, 
deletion,  identification,  retrieving,  and  saving  of  the  specific  data  types  used  by  the  pro* 
gram.  It  is  program  specific  (meaning  that  the  procedures  relate  to  this  specific  application 
only).  This  unit  specifies  the  record  data  types  for  the  nodes  and  arcs,  and  declares  global 
variables  used  for  system  data  control. 

A.1.4  Show  Unit  The  Show  unit  contains  the  procedures  that  create  the  graphic 
representations  and  the  procedures  that  implement  the  manipulation  functions  of  proba* 
blllty  ratio  graphs.  The  majority  of  this  unit  is  devoted  to  the  graphics  support  function. 
The  manipulation  functions  are  encoded  in  three  main  procedures;  1)  triangulate  (trlan- 
gulatlon),  2)  explode  (aggregation),  and  3)  cluster  (disaggregation).  This  unit  is  program 
specific. 


Graphics  support.  The  graphics  support  provides  for  two  ways  of  viewing  the 
system:  1)  The  nodes  can  be  viewed  individually  as  a  pie  chart  where  the  pie 
sections  represent  embedded  nodes.  2)  The  nodes  can  be  viewed  as  a  connected 
graph  of  miniaturized  pie  charts.  The  span  of  the  arcs  In  each  pie  chart  reflects 
the  relative  probability  of  the  nodes  conditioned  on  the  parent  node.  The 
connected  graph  representation  shows  the  parent  node  as  a  miniaturized  pie 
chart  in  the  lower  right  corner  of  the  graphics  viewport,  and  the  connected 
graph  shows  the  arc  connections  between  the  embedded  nodes.  The  connected 
graph  representation  has  the  advantage  of  presenting  more  information  at  one 
time,  while  the  pie  chart  has  more  resolution. 

Triangulatlon.  The  triangulation  procedure  is  an  extended  form  of  the  trlan- 
gulation  function  described  in  Chapter  III.  It  can  triangulate  between  any  two 
nodes  In  a  connected  graph  regardless  of  the  current  connection  path.  It  docs 
this,  in  essence,  by  automatically  performing  repeated  triangulatlons  along  the 
connection  path  until  the  two  goal  nodes  are  connected.  If  the  two  specified 
nodes  are  currently  connected,  then  the  triangulatlon  function  either  reverses 
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the  arc  direction  or  doee  nothing.  It  reveries  the  arc  direction  if  the  original 
arc  direction  ii  opposite  the  specified  direction.  If  the  original  and  specified 
orientations  are  the  same,  then  triangulation  has  no  effect, 

Aggragation.  The  explode  procedure  accomplishes  the  aggregation  function. 
This  procedure  is  **hot<wlred''  because  instead  of  using  the  arc  ratios  directly  to 
create  the  Joint  representation,  It  uses  the  arc  ratios  to  calculate  the  conditional 
probabilities,  and  these  probabilities  to  reconnect  the  arcs,  forming  the  Joint 
representat'  i. 

Disaggragatton,  The  clutter  procedure  accomplishes  the  disaggregation  func* 
tlon.  This  procedure  uses  the  arc  ratios  for  forming  the  conditional  repreienta* 
tion.  Hov/ever,  It  can  only  collect  two  nodes  at  a  time  and  in  doing  so  It  creates 
a  new  parent  node.  That  Is,  there  Is  no  direct  way  to  add  an  existing  node  to 
an  embedded  graph,  lb  include  a  node  in  an  embedded  graph  one  must,  1) 
cluster  the  object  node,  Ng,  with  the  parent  node  containing  the  target  embed* 
ded  graph,  Afpt  (this  creates  a  new  parent  node,  fVpi,  containing  and  Npt 
u  a  two  element  embedded  graph.);  then  2)  explode  Mpi  which  connects  Mo  to 
the  original  target  embedded  graph. 


A,I,S  Menu  l/nlt  The  Menu  unit  contains  the  procedures  for  program  control  and 
user  Interfacing.  This  unit  is  program  specific  In  that  the  menu  procedures  are  geared 
toward  the  procedures  in  this  program.  However,  the  overall  menu  format  works  with  the 
screen  structure  defined  by  the  Ports  unit,  and  can  be  used  for  any  application.  If  used 
for  a  different  application,  or  even  an  extended  version  of  the  current  program,  the  specific 
menu  procedures  would  have  to  be  rewritten  or  upgraded  to  reflect  the  change. 

AJ.S  Nodes  and  Arcs  In  this  program  the  nodes  are  the  major  objects  (or  data 
structures),  and  therefore  have  many  attributes.  Some  of  the  attributes  are  used  solely  for 
graphics  support.  Table  3  lists  the  attributes  associated  with  nodes. 
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Variable 

Type 

Purpose 

Index 

String 

The  array  element  pointer  which  delineates  where  the 
data  reiating  to  the  node  resides  in  heap  memory. 

Name 

The  iabel  supplied  by  the  user. 

wmm 

String 

A  list  of  the  node’s  embedded  nodes. 

Parent 

The  node  in  which  this  node  is  embedded. 

ConArc 

String 

Prob 

Real 

The  node’s  conditional  probability,  conditioned  on  the 
parent  node. 

Color 

Integer 

The  color  of  the  node  (used  for  graphics). 

Xpos 

The  ’’X”  position  of  the  center  of  tlie  node  (used  for 
graphics). 

Ypos 

Integer 

'I'he  “V**  position  of  the  center  ot  the  node  (used  for 
graphics). 

Rad 

Integer 

The  radius  of  the  node  (used  for  graphics). 

Table  3.  Node  record  attributes. 


Like  the  nodes,  arcs  also  have  various  attributes.  However,  unlike  the  nodes,  arcs  do 
not  need  any  parameters  speclflcally  for  graphics  support.  Because  they  connect  nodes, 
they  use  the  nodes*  parameters  for  the  graphics  information.  Table  4  lists  the  attributes 
associated  with  arcs, 


Variable 

Type 

Purpose 

Index 

String 

The  array  element  pointer  which  delineates  where  the 
data  relating  to  the  arc  resides  in  heap  memory. 

Head 

String 

The  node  at  which  the  arc  originates. 

Tail 

The  node  at  which  the  arc  terminates. 

Ratio 

Real 

The  ratio  of  the  nodes’  probabilities,  Ratio  = 

Tabie  4.  Arc  record  attributes. 


A, 1,1  Global  Variables  This  program  uses  many  global  variables  for  defining  the 
state  of  the  system.  They  provide  a  means  for  access  to  system  status,  and  for  information 
transfer  across  procedures.  The  important  system  global  variables  are  listed  in  Table  5 
(these  global  variables  deflue  the  state  of  the  system). 
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Variable 

Type . 

Purpose 

N 

Array 

This  is  the  array  for  the  node  record  pointers.  The  “In¬ 
dex^  parameter  for  the  nodes  is  derived  from  this  pointer. 

A 

Array 

This  is  tke  array  for  the  arc  record  pointers.  The  "Index” 
parameter  for  the  arcs  is  derived  from  this  pointer. 

Ni 

Integer 

An  index  which  is  Incremented  when  a  new  node  is  cre¬ 
ated.  The  term  "new  node”  as  used  In  this  context  refers 
to  a  new  node  record.  Once  a  record  is  created  it  is  never 
destroyed.  When  a  node  is  deleted  Its  Index  Is  added  to 
the  inactive  node  list  so  when  a  new  system  node  Is  cre¬ 
ated  the  heap  memory  space  can  be  recycled.  “Nl”  equals 
the  number  of  nodes  In  the  active  and  inactive  node  lists. 

Ai 

Integer 

ActiveN 

String 

A  list  of  the  active  nodes*  indices.  An  active  node  Is  any 
node  that  represented  In  the  system. 

InActiveN 

String 

A  list  of  the  nodes  that  have  been  deleted.  Once  deleted 
the  node’s  record  space  becomes  available  for  reuse. 
Therefore,  the  Indices  of  and  the  memory  for  the  deleted 
nodes  are  recycled. 

ActiveA 

String 

Performs  the  same  function  for  the  arcs  as  “ActiveN” 
does  for  the  nodes. 

InActlveA 

String 

Performs  tke  same  function  for  the  arcs  as  “InActiveN” 
docs  for  the  nodes. 

Table  5.  System  defining  global  variables. 


There  are  many  more  global  variables  which  are  used  as  temporary  Information 
storage  for  Information  transfer  across  procedure  boundaries.  The  specific  purpose  of 
these  additional  variables  Is  described  In  appendix  B. 

A, 1,8  Data  files  The  data  files  contain  just  enough  Information  to  reconstruct  the 
system  state  when  It  was  saved^.  The  Information  needed  to  reconstruct  the  system  state 
involves  1)  system  global  variables,  2)  node  parameters,  and  3)  arc  parameters. 


1.  System  global  variables 
•  ActiveN 


*  A  data  file  could  be  created  without  saving  a  previoualy  created  lystem,  however,  tills  may  cause  syntax 
problems  that  would  cause  the  program  to  crash  while  loading  the  data  file. 
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1^ 


•  ActiveA 

t  InActiveN 

•  Ni 


2.  Node  parameters 

•  Index^ 
t  Name 

•  Parent 

3.  Arc  parameters 

s  Head 
s  IVdl 

•  Ratio 

The  structure  of  the  data  files  follows  this  order^, 

1.  ActlveN 

2.  Node  parameters  (Name,  Parent) 

3.  ActiveA 

4.  Arc  parameters  (Head,  Tail,  Ratio) 

6.  InActiveN* 

6.  Ni 

A.S  Program  U$« 

To  run  this  program  you  wili  need  Turbo  Pascal,  version  4.0  or  iater,  and  at  least 
the  following  flles^  !  1)  Test.pas,  2)  Lst.pas,  3)  Ports, pas,  4)  Parts. pas,  h)  Show.pns,  and 
6)  Menu. pas.  There  are  also  data  flies  associated  with  this  program  that  are  ready  to  bo 
loaded  for  an  example  of  how  the  system  works*:  1)  SCOTT,  and  2)  ERIC. 

To  initiate  the  program,  ensure  that  all  of  the  necessary  flies  above  are  present  in  the 
same  directory,  load  “test.pas”,  and  press  <ctrl>F9  This  will  compile  the  main  program 
and  all  of  the  necessary  units*. 

^The  index  ii  containrd  in  the  "ActlvoN"  Hit. 

''lb  see  the  order  of  a  data  file,  simply  view  one— they  are  ASCII  files. 

'If  the  Inactive  node  list  is  empty  then  this  parameter  Is  set  equal  to  "NONE.” 

'The  ".pas*  files  are  the  original  code.  The  ".tpu”  files  for  2*S  are  actually  needed  to  run  the  program. 
These  files  will  be  created  when  the  main  program,  "test.pas”,  Is  compiled. 

'These  data  files  are  not  necessary  to  tun  the  program. 

'If  the  ".tpu*  files  for  the  necessary  units  do  not  already  exist,  <cttl>F9  will  create  them. 
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Figure  21.  Screen  format. 


The  screen  will  be  split  up  Into  four  separate  areas  as  shown  In  figure  21.  Viewport  2 
Is  the  menu  viewport;  all  the  main  program  options  are  displayed  within  viewport  2  using 
several  different  menus.  The  program  currently  has  six  available  menus; 


1.  Mainmenu  -  the  top  level  menu  procedure  from  which  the  other  menus  originate. 

2.  Setupmonu  -  submenu  of  mainmenu,  offers  options  for  basic  system  configuration. 

3.  Qraphmenu  -  submenu  of  mainmenu,  offers  options  for  viewing  the  system  and  per¬ 
forming  probability  ratio  graph  manipulations. 

4.  Creti*emenu  -  submenu  of  mainmenu,  offers  options  for  creating  the  system  objects 
(nodes  and  arcs). 

6.  Altermenu  -  submenu  of  sotupmenu,  offers  options  for  altering  object  parameters. 

6.  Alterarcmenu  -  submenu  of  altermenu,  offers  options  for  altering  arc  parameters. 

Because  the  program  is  in  the  development  mode,  the  menus  are  somewhat  chaotic 
and  over-redundant.  As  the  program  develops  the  menus  should  mature  into  a  well  defined 
structure  which  separates  the  options  in  a  meaningful  way. 
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A.t.l  Menus  Eftch  menu  can  dliplay  up  to  six  of  the  available  optlons^*^.  The 
lilted  optloni  can  be  lelected  by  either  preiilng  the  aiioclated  number  or  ilrit  letter  of 
the  option.  There  are  three  optloni  that  can  be  lelected  whether  they  are  lilted  or  not: 
1)  "Back**,  return!  to  the  menu  one  level  up;  2)  **Maln  Menu”,  returni  to  the  main  menu; 
and  3)  '*Qalt*',  termlnatei  the  program.  If  they  are  not  lilted,  theie  three  optloni  can  be 
lelected  by  preiilng  the  flrit  letter  (B,  M,  or  Q),  If  they  are  lilted,  they  can  be  lelected  by 
either  the  number  or  the  flrit  letter. 

Main  Menu  The  main  menu  li  the  top  level  control  procedure.  The 
available  optloni  and  their  purpoiei  are  deflnod  In  table  6. 


Option 

Purpoie 

Initiates  the  setup  menu. 

2)  Create 

Initiates  the  create  menu. 

3)  Qrapk 

Initiates  tlte  grapK  menu. 

4)  Initialize* 

This  option  initializes  the  system  parameters.  All  of 
the  active  nodes  and  arcs  are  added  to  their  respective 
inactive  lists  and  the  active  lists  are  set  to  nil. 

5)  Bit  Image 

This  li  a  non-functioning  option.  It  was  to  use  Turbo 
Pascal’s  ability  to  save  a  bit  Image  so  the  graphics 
could  be  printed.  However,  this  may  not  be  possible. 

6)  Quit 

Terminates  the  program. 

*Note!  The  Initiallie  option  does  not  prompt  the  user  before  resetting 
the  lyitem  parameters.  Currently,  there  is  no  way  to  recover  lost  data 
whether  inadvertent  or  not. 

Table  0.  Main-menu’s  options  and  their  purpose. 


As  with  all  the  menu  procedures,  the  mainmenu  procedure  uses  a  while  loop  and  a 
case  statement  to  control  the  option  selections.  The  the  while  loop  provides  for  errors  In 
selection  (an  accidental  selection  will  not  crash  the  program). 

A.i.l.S  Setup  Menu  The  setup  menu  provides  the  options  for  loading  data 
Ales  and  saving  current  system  information  to  a  data  file  (there  are  other  options  but  their 

‘"An  "av&iUble"  option  ii  an  option  that  can  be  initiated  from  the  cutront  menu. 
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functloni  are  somawhat  limited.)'  The  available  optioni  and  their  purposes  are  listed  in 
table  7. 


Option 

Purpose 

1)  Load  Data 

Provides  the  capability  to  load  a  data  file  containing 
a  previously  constructed  system  conAguration. 

2)  Save  Data 

Provides  the  capability  ^or  saving  a  system  conAgu* 
ration  for  use  at  another  time. 

3)  InitlallM 

Same  option  as  listed  In  the  main  menu. 

4)  Alter 

brings  up  tbe  alter  menu. 

5  Main  Menu 

Heturns  control  to  the  main  menu. 

6)  Quit 

Terminates  the  program. 

Table  7,  Setup<menu's  options  and  their  purpose. 


A,9,1,S  Graph  Mem  The  graph  menu  provides  the  options  for  viewing  the 
system  and  performing  probability  ratio  graph  manipulations.  The  available  options  and 
their  purposes  are  listed  in  table  8. 


Purpose 

1)  Pie 

Displays  the  speclAed  node  as  a  pie  chart  where  the 
sections  represent  the  conditional  probabilities  of  the 
embedded  nodes. 

2}  Net 

Displays  the  spectAed  node's  miniaturized  pie  chart  in 
the  lower  corner  and  the  embedded  nodes  as  a  con¬ 
nected  graph. 

3)  Explode 

Performs  the  aggregation  function  on  the  speclAed 
node  and  displays  the  parent  node’s  resulting  con¬ 
Aguration  in  the  net  representation. 

Him 

Performs  disaggregation  on  the  two  speclAed  nodes 
and  displays  the  parent  node’s  resulting  conAguration 
in  the  net  representation. 

5)  Find  path 

Finds  the  connection  path  between  the  two  speclAed 
nodes. 

6)  Triangulate 

Performs  triangulation  with  the  two  speclAed  nodes. 

Table  8.  Graph-menu's  options  and  their  purpose. 
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A,M,1.4  Create  Mem  The  create  menu  provides  the  options  for  creating  sys¬ 
tem  objects  (nodes  and  arcs)  and  setting  their  parameters.  The  available  options  and  their 
purposes  are  listed  in  table  9. 


Option 

Purpose 

Creates  a  new  node  and  prompts  the  user  for  the 
node's  parameters. 

2) 

(No  option  currently  available) 

Creates  a  new  arc  and  prompts  the  user  for  the  arc's 
parameters. 

4) 

(No  option  currently  available) 

6)  Main  Menu 

Returns  control  to  the  main  menu. 

Terminates  the  program. 

Table  9.  Create-menu’s  options  and  their  purpose. 


A.S,1,5  Alter  Mem  The  alter  menu  was  Intended  to  provide  options  for  al¬ 
tering  the  objects*  (nodes*  or  arcs')  parameters.  As  It  now  exists,  only  arc  parameters 
can  be  altered  through  this  menu.  The  available  options  and  their  purposes  are  listed  In 
table  10. 


Option 

Purpose 

1)  Hypothesis 

(Currently,  this  option  has  no  purpose.) 

2)  Evidence 

(Currently,  this  option  has  no  purpose.) 

3J  Arc 

Initiates  the  alter-arc  menu. 

4)  Cluster 

Peribrms  disaggregation  on  the  two  specified  nodes 
and  displays  the  parent  node's  resulting  configuration 
in  the  net  representation  (same  option  as  in  the  graph 
menu). 

6)  Main  Menu 

Returns  control  to  the  main  menu. 

6)  Quit 

Terminates  the  program. 

Table  10.  Alter-menu*s  options  and  their  purpose. 


A,S.1.6  AlterArc  Mem  The  alterarc  menu  was  intended  to  be  one  of  three 
submenus  which  would  provide  options  for  altering  the  objects*  parameters.  Currently,  it 
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ii  the  only  one  of  these  lubmenui  which  exiiti,  and  it  really  has  no  value  in  the  current 
system.  The  available  options  and  their  purposes  are  listed  in  table  11, 


Option 

Purpose 

KoasaH 

(Currently,  this  option  has  no  purpose.) 

IH^ 

Reverses  the  spociAed  arc’s  orientation  (this  function 
can  be  accomplished  with  the  trlangulatlon  option 
and.  In  any  case,  is  of  little  practical  use.). 

3)  Change  Ratio 

(Currently,  this  option  is  non*functlonlng) 

4) 

(No  option  currently  available) 

Returns  control  to  the  main  menu. 

Terminates  the  program. 

Table  11.  Alter  Arc-menu's  options  and  their  purpose. 


A.t.S  Siariing  Out  Once  the  program  Is  loaded  and  running,  the  main  menu  should 
mysteriously  appear  in  viewport  2.  At  this  point  you  can  either  load  a  file  or  begin  from 
scratch.  To  load  a  file  choose  the  “Setup"  option  to  Initiate  the  setup  menu;  from  the 
setup  menu,  choose  “Load  Data."  You  will  be  prompted  for  the  name  of  the  data  fllo  to 
load.  If  you  enter  nothing  then  the  program  will  return  and  you  can  continue  as  if  nothing 
happened.  However,  if  you  enter  a  Ale,  then  that  Ale  must  exist  and  contain  information 
in  the  correct  syntax  for  the  program  to  use  or  the  program  will  crash  (there  is  no  error 
chocking  Involved  with  loading  data).  To  begin  from  scratch  choose  the  “Create"  option 
to  Initiate  the  create  menu.  To  create  system  all  that  is  needed  Is  the  “Node"  option  in 
the  create  menu.  Using  the  node  option  will  prompt  for  all  the  information  needed  during 
creation.  Several  system  aspects  are  Important:  1)  A  parent  node  must  contain  at  least 
two  nodes  to  be  a  parent  (a  node  cannot  contain  a  single  node).  2)  A  node  must  be  part 
of  a  connected  graph  (a  node  has  to  be  connected  to  another  node  by  an  arc),  The  node 
option  prompts  for  all  the  necessary  information. 

The  best  way  to  become  familiar  with  the  process  is  to  create  and  run  througli  an 
example.  Figure  5  in  Chapter  III  show  a  simple  example;  you  may  want  to  use  this  Aguro 
to  check  your  results. 
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Appendix  B.  Procedure  and  Function  Reference  Lookup 


Thli  appendix  contains  the  descriptions  of  the  global  variables,  and  the  procedures 
and  functions  contained  In  table  12.^  The  global  variables  are  arranged  by  units,  and  the 
procedures  and  functions  are  arranged  alphabetically. 

B.l  Global  Variablet 


ITPorii 

QraphDrlvar 

Used  to  detect  the  system  type. 

QraphMode 

Used  to  detect  the  system  graphics  mode. 

MaxX, 

MaxY 

Used  for  relative  positioning  within  different  viewports. 

BO,  FG 

These  are  the  current  port  background  and  text  colors  respectively. 

CP 

The  current  port  number  Is  stored  here. 

cpXl,  epYl 

Current  cursor  position  for  port  1. 

cpX4,  epY4 

Current  cursor  position  for  port  4. 

xa,  xs,  X4 

Horisontal  scaling  variables  for  separating  the  screen  into  the  four 
viewports. 

Y2,  Y5 

Vertical  scaling  variables  for  separating  the  screen  into  the  four  view¬ 
ports. 

xAsp,  yAsp 

Horizontal  and  vertical  screen  resolutions. 

AspeetRatlo 

Screen  aspectratlo  used  for  graphics. 

II 1  LH'i'li'IH'll  II 

Quit 

Used  for  menu  control  between  and  within  menu  procedures. 

N,  A  Arrays  for  the  “node”  and  “arc”  pointers. 

Nl,  Ai  Counters  to  keep  track  of  the  total  number  of  nodes  and  arcs  that 

have  been  created. 


‘Most  of  the  procedutei  from  the  Menu  Unit  have  been  omitted  became  they  are  of  the  lame  fornial 
and  lerve  an  control  mechaniimi,  They  are  not  generally  applicable  procedurei. 
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Ool  Used  to  Milgn  nodes  different  colors  as  they  are  created. 

AeiivaN  List  of  active  system  nodes. 

AetIvaA  List  of  active  system  arcs. 

InAetiveN  List  of  deactivated  nodes, 

InAetlvtA  List  of  deactivated  arcs. 

VlaAre  List  of  the  visible  arcs  so  they  are  only  displayed  once, 

VleNode  List  of  the  visible  nodes  so  arcs  are  only  displayed  between  visible 

nodes. 

Problit  List  of  the  nodes  whose  **Prob**  parameters  have  been  set  so  they  are 

only  set  once  during  an  Iteration. 

Lnod«  The  last  created  node,  used  to  automatically  create  new  arcs. 

Onoda  If  there  are  two  newly  created  nodes  that  have  not  yet  been  connected 

by  an  arc,  then  this  is  the  other  node. 


ow 


:>inT)Brrinqrri 


Goal  Used  In  trlangulatlon,  this  Is  the  goal  node. 

Path  List  variable  used  to  build  the  path  between  two  nodes.  Used  for 

trlangulatlon. 

Garoe  List  of  arcs  connected  to  a  node.  Used  In  for  trlangulatlon. 
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B.i  Procedure*  and  Punclione 


Append 

Lst 

Parts 

AppendT 

Lst 

MakePath 

Show 

Choice 

Ports 

Memlst 

Lst 

Cluster 

Show 

Minlst 

Let 

Common 

Lst 

Net 

Show 

Connected 

Show 

NewArc 

Parts 

Delmem 

Lst 

Newnode 

Parts 

DrawArc 

Show 

Nummem 

Lst 

Drawpie 

Show 

OtherNode 

Parti 

Explode 

Show 

Out 

Ports 

FlgNet 

Show 

OutT 

Ports 

FigProbi 

Show 

Pie 

Show 

FlgRatlo 

Show 

Rest 

Lst 

FlUBk 

Ports 

RestT 

Lst 

FlndPath 

Show 

ReverseArc 

Show 

First 

Lst 

Savedata 

Parts 

FlrstT 

Lst 

SetPort 

Ports 

Growup 

Show 

SetProbi 

Show 

HideArc 

Show 

ShowArc 

Show 

InltParts 

Parts 

Showmenu 

Menu 

InitPorts 

Ports 

Sum 

Show 

Loaddata 

Parts 

Triangulate 

Show 

Makearc 

Parts 

Which 

Parts 

Table  12.  Procedures  used  in  probability  ratio  graph  software. 

The  procedure  and  function  look-up  follows  the  order  in  table  12.  They  are  listed  In 
the  following  format  (only  the  relevant  Items  are  listed  with  each  entry). 


ample  procedure 


Function  What  it  does 

Declaration  How  lt*s  declared 

Reiult  type  What  It  returns  if  it*s  a  function 

Remarks  General  information  about  the  procedure 

Restrictions  Things  to  be  aware  of 


nit  contained  in 


Sm  alto  Related  procedurei/functloni 

Bxampla  Sample  program  or  code  fr^[ment 

Thli  guide  only  lUti  procedural  and  functions  contained  In  the  units  Lat,  Ports, 
Parts,  Show,  and  Menu.  A  Turbo  Pascal  guide  should  be  referenced  for  procedures  and 
functions  contained  In  the  original  Turbo  Pascal  software. 


Append  hinciion 


Lit 


Function 

Declaration 

Raiuit  type 
Remarks 

Restrictions 


See  also 

Example 


Returns  the  concatenation  of  X  and  Y  In  list  format, 
append(X,  Y  ;  String) 

String 

This  function  Joins  the  two  specified  strings  In  list  format.  That  Is, 
with  a  comma  separating  the  two  strings. 

The  final  string  length  Is  limited  to  255  characters.  If  the  two  spec¬ 
ified  strings  lengths  are  greater  than  254  when  added  together  (254 
because  a  comma  Is  Inserted  between  the  two  strings),  then  the  re¬ 
turned  string  will  be  truncated  at  the  255th  character. 

AppendT 
X  a,c,e,f{ 

Y  g,th,idf,vj 

S  !■  append(X,  Y); 

in  this  example,  S  b  a,c,o,f,g,th,idf,v 


AppendT  function 


Lit 


Function 
Declaration 
Result  type 
Remarks 


Restrictions 


Concatenates  two  strings  separated  with  a  blank  space. 
appendt(X,  Y  ;  String) 

String 

This  function  joins  the  two  specified  strings  in  in  sentence  format. 
That  is,  with  a  space  separating  the  two  strings.  It  is  used  for  sup¬ 
porting  the  word  wrapping  capability  while  in  the  graphics  mode. 

String  lengths  cannot  exceed  255.  This  Is  a  limitation  of  Turbo  Pascal 
string  data  types.  If  the  two  string  lengths  exceed  254  when  added 
(254  because  a  space  is  inserted  between  them),  then  the  resulting 
string  will  be  truncated  at  the  255th  position. 
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V 


See  alio  Append,  FirstT,  ReitT 

Example  X  :b  Thii  unit  Is*; 

Y  ia  'made  up  of...*: 

S  :n  appendt(X,  Y); 

In  thla  example,  S  b  'This  unit  la  made  up  of.. 


Function 

Declaration 

Remarks 


See  also 


Performs  the  “disaggregation**  function  of  probability  ratio 

graphs. 

cluster 

This  procedure  gathers  two  nodes  (vertices)  In  to  one  node,  After 
performing  all  of  the  necessary  administrative  functions  on  the  lys* 
tern  variables  It  redisplays  the  new  system  configuration  In  the  net 
representation. 

Explode,  Triangulate 


ommon  function 


Function  ChecI 


Function  Checks  If  there  any  common  members  In  the  two  specified 
lists. 

Declaration  common(lstl,  lst2  ;  String) 

Result  type  Boolean 

Remarks  This  function  operates  on  lists  where  the  niumbers  are  delineated 

with  commas. 

See  also  Memlst 

Example  Istl  ‘.s  *a,s,d,f*; 

Ut2  :b  *w,r,t,d,q*; 
common(l8tl,  lst2); 

In  this  example,  common  ■>  true 


Function  Checki  if  two  ipeclfled  nodes  are  connected  by  an  arc, 

Doelmtion  connected(nodel|  node2  :  String) 

Roault  type  Boolean 

Remark!  This  Ibnctlon  checks  the  two  ipeclfled  nodes’  connected  arc  (ConArc) 
lilts  for  common  members. 


II!: 


eimem 


Function 
Declaration 
Result  type 
Remarks 

Example 


Deletes  all  Instances  of  X  from  the  list  Y. 
dehnem(X,  Y  t  String) 

String 

This  function  operates  on  lists  where  the  members  are  tlullneated 
with  commas. 

X  a; 

Y  !■  a,i,f,r,t,a,d; 

S  !■  delmem(X,  Y)t 
In  this  example,  S  ■  s,f,r,t,d 


rawAre  procedure 


Function  Draws  the  ipeclfled  arc  In  the  ipeclfled  color. 

Declaration  drawarc(S  ;  String;  K  :  Integer) 

Remarks  This  procedure  porforros  the  calculations  and  Inltlalos  the  graphics 
for  displaying  arcs. 

See  also  ShowArc,  lIldoArc 


IrawPie  procedure 


Function  Draws  the  ipeclfled  node  as  a  pie  chart. 

Declaration  drawple(S  :  String) 

Remarks  This  procedure  displays  the  specifled  node  as  a  pie  chart  with  the 
pie  slices  representing  the  nodes  In  the  embedded  graph. 

See  also  Pie,  Net,  FigProbs 


Function  Performa  the  ^^aggregation**  function  of  probability  ratio 

graphs. 

Declaration  explode(S  ;  String) 

Remarka  This  procedure  replaces  the  apecifled  node  with  its  embedded  graph. 

The  embedded  graph *s  conditional  representation  is  transformed  into 
a  joint  representation. 

See  also  Cluster,  Triangulate 


gNet  procedure 


Function  Seta  the  “Prob**  relative  to  the  arc  ratios. 

Declaration  flgnet(C,  S  :  String) 

Remarka  This  procedure  seta  the  “Prob**  values  of  the  members  of  a  connected 
graph  relative  to  the  ratios  of  the  arcs  connecting  the  graph. 

See  also  FigProbs 


grroDi  procedure 


Show 


Function  Initiates  the  update  of  the  node  "Probs**  to  reflect  the  con¬ 
necting  arc  ratios. 

Declaration  flgprob8(S  i  String) 

Remarks  This  procedure  Is  used  in  conjunction  with  FlgNet,  Sum,  and  Set- 
Probs  to  update  the  probabilities  of  a  connected  graph. 

See  also  FlgNet,  Sum,  SetProbs 


igRatio  function 


Function  h  Igures  the  ratio  between  two  bpeclfled  nodes,  connecting  arc 
ratios. 

Declaration  flgratlo(H  :  String) 

Result  type  Ileal 

Remarks  This  function  uses  the  path  generated  by  FlndPath/MakePath  to 

figure  the  ratio  between  two  nodes.  It  Is  used  in  the  triangulation 
procedure. 

See  also  FindPath,  MakoPath,  Triangulation 
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:  procedure 


IfFniBR 


Function 

Declaration 

Remarks 


See  alio 


Displays  a  filled  polygon  with  a  border. 
flllbk(Xl,  Yl,  X2,  Y2,  BC,  TC  ;  Integer) 

This  procedure  is  used  for  setting  up  the  different  viewports,  and 
scrolling  functions  and  clearing  viewports.  XI  and  Yl  are  the  top 
right  coordinates  of  the  polygon,  and  X2  and  Y2  are  the  lower  left 
coordinates  of  the  polygon.  BC  is  the  background  color  and  TC  is 
the  border  and  text  color. 

Out,  InitPorts 


II  FindPath  procedure 


Function 

Declaration 

Remarks 


See  also 


Finds  the  path  between  two  nodes, 
flndpath 

This  procedure  is  used  in  conjunction  with  MakePath  in  the  Trian¬ 
gulate  and  Cluster  procedures.  The  iwo  nodes  must  be  members  of 
the  same  connected  graph. 

MakePath,  Triangulate,  Cluster 


I  First  function 


T5F 


Function 

Declaration 

Result  type 
Remarks 

See  also 
Example 


Returns  the  first  member  of  a  list. 
flrst(X  :  String) 

String 

This  function' operates  on  lists  where  the  members  are  delineated 
with  commas. 

FlrstT,  Rest,  RestT 
X  !=  a,s,d,l'; 

S  !=  flr8t(X); 

In  this  example,  S  «  a 


irWitT  Knctlon 


Lst 


Function 
Declaration 
Result  type 
Remarks 


Returns  the  first  member  of  the  specified  list. 
flrstt(X  !  String) 

String 

This  function  operates  on  lists  where  the  members  are  delineated 
with  idank  spaces. 
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See  also 
Example 

RestT 

X  IB  ’the  node  is  not  active...’; 

S  IB  flrstt(X); 

In  this  example,  S  »  ’the’ 

Growup  procedure 

Show 

Function 

Declaration 

Remarks 

See  also 

Changes  the  "Parent”  of  embedded  nodes  to  their  Grandpar¬ 
ent. 

growup(C,  P  1  String) 

This  procedure  is  used  In  conjunction  with  the  explode  procedure. 
Explode 

HldeAre  procedure 

Show 

Function 

Declaration 

Remarks 

See  also 

Removes  an  arc  from  the  screen. 
hldearc(S  i  String) 

This  procedure  draws  over  existing  arcs  In  the  background  color  ren¬ 
dering  the  invisible. 

DrawArc,  Show  Arc 

InitParts  procedure 

Function 

Declaration 

Remarks 

Initializes  system  variables, 
inltparts 

This  procedure  initializes  the  system  variables.  If  used  while  the 
system  has  data,  the  will  be  lost.  It  gives  no  warnings. 

InltPorts  procedure 

Ports 

Function 

Declaration 

Initializes  the  system  screen  and  sets  the  output  variables. 
Initports 

Remarks  This  procedure  Initializes  the  screen  and  the  output  variables  that 
deal  with  the  screen  parameters. 

See  also  FlllBk 


7B 


0 


Loaddata  procedlure 


Parts 


Function 

Declaration 

Remarks 


See  also 


Reads  a  specified  data  file  and  recreates  the  system  as  road 

from  the  file. 

loaddata 

This  procedure  retrieves  data  from  the  specified  file  and  creates  the 
nodes  and  arcs  specified  In  the  file.  The  specified  file  must  be  in  the 
proper  format  or  it  will  cause  a  runtime  error. 

Savedata 


MakoArc  procedure 


Parts 


Function 

Declaration 

Remarks 


See  also 


Controls  the  input  and  output  functions  for  creating  a  new 

arc.  siblings. 

makearc 

This  procedure  handles  the  input  and  output  information  gathering 
function  for  arc  creation.  It  checks  the  nodes  to  ensure  that  they 
share  the  same  parent.  It  will  accept  the  ratio  as  a  single  number  or 
as  a  fraction  (.6  or  1/2). 

MakeNode,  New  Arc 


MakeNode  procedure 


Parts 


Function 

Declaration 

Remarks 


See  also 


Controls  input  and  output  for  creating  a  new  node, 
makenode 

This  procedure  handles  the  input  and  output  Information  gather¬ 
ing  function  for  node  creation.  It  queries  for  the  needed  initial  pa¬ 
rameters,  checks  for  valid  parenthood,  and  ensures  the  node  will  be 
connected  to  a  sibling  node. 

MakeArc,  NewNode,  OtherNode 


MakePath  procedure 


Show 


Function 

Declaration 

Remarks 

See  also 


Creates  a  list  which  represents  the  connection  patli  butwoon 
the  specified  nodes. 
makepath(H,  T,  Sa  ;  String) 

This  procedure  build  a  list  of  arcs  whicli  connects  the  specified  nodes 
(H  and  T).  This  is  a  recursive  procedure  and  "Sa”  is  a  parameter 
used  for  controlling  the  recursion. 

FlndPath 
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emlit  function  Lst 


Function  Determlnei  whether  a  string,  X  is  a  singular  member  of  the 
list,  Y. 

Declaration  memlst(X,  Y  :  String) 

Result  type  Boolean 

Remarks  This  function  operates  on  lists  where  the  members  are  delineated  by 
commas.  If  X  or  Y  are  empty,  then  the  value  of  memht  is  false. 

See  also  Common 

Example  X  :■  a| 

Y ;»  c,d,a,8,r; 
if  memlst(X,  Y)  then... 

else...; 

In  this  example,  memlst  s  true 


Function 

Returns  the  specified  list  with  all  repeated  members  deleted. 

Declaration 

minltt(X  :  String) 

Result  type 

String 

Remarks 

This  function  operates  on  lists  where  the  members  are  delineated 

with  commas. 

Example 

X  ;■  a,d,a,c,s,c; 

S  ias  minlst(X); 

In  this  example,  S  s  a,d,c,8 

et  procedure 


Function  Displays  the  specified  node’s  embedded  graph  as  a  connected 
graph  of  pie  charts. 

Declaration  net(S  ;  String) 

Remarks  This  procedure  calculates  the  positions  of  tlie  children  nodes  of  "S" 
and  displays  the  children  as  pie  charts  connected  with  arcs, 

See  also  Pie 


Function  Initialises  a  new  arc  pointer  and  sets  the  new  arc’s  parame¬ 
ters. 


T7 


DacUration 

Remarki 


S«e  alio 


nQwarc(H,  T  :  String;  II :  Real) 

Thil  procedure  creates  a  new  arc  and  initializes  the  arc’s  parameters 
and  echos  the  arc’s  creation  to  viewport  4.  “H”  is  the  head,  “T”  is 
the  tail,  and  ’’R”  is  the  ratio  between  them. 

MakeArc,  NewNode 


NewNode  procedure 


Parts 


Function 

Declaration 

Remarks 


Sea  also 


Initializes  a  new  node  pointer  and  sets  the  new  node’s  pa< 
rameters. 

newnode(Na,  P  :  String) 

This  procedure  creates  a  new  node,  Initializes  the  node’s  parameters, 
and  echos  the  node's  creation  to  viewport  4.  “Na”  Is  the  node's  name 
and  "P”  is  its  Parent. 

MakeArc,  NewArc 


‘EsT 


Nummam  hinctlon 


Function 

Declaration 

Result  type 
Remarks 

Example 


Returns  the  number  of  members  in  a  list. 
nummem(S  ;  String) 

Integer 

This  function  operates  on  lists  where  the  members  are  delineated 
with  commas. 

S  !■  a,s,d,f! 

I  !M  nummem(S); 

In  this  example,  I  «  4 


diherNode  procedlure 


Parts 


Function 

Declaration 

Remarks 

See  also 


This  procedure  Is  called  by  MakoNodo  when  the  spoclAod 
parent  contains  no  children. 
othernode(P  i  String) 

This  procedure  Is  called  when  a  node  Is  created  and  the  parent  la 
otherwise  childless.  Parent  nodes  must  contain  at  leiul  two  children. 
MakeNode 


II  0ut  procecHure 


Function 


Outputs  a  list  string  with  word  wrapping  to  the  current  port. 


Declaration 

Remarks 


See  also 


out(S  ;  String) 

This  procedure  outputs  the  string  “S**,  which  Is  a  list  where  the 
members  are  separated  with  commas,  to  the  current  port  and  enables 
text  wrapping  while  In  the  graphics  mode. 

OutT 


II  OutT  procedure 


I^orts  II 


Function 

Deelaraiton 

Remarks 


See  also 


Outputs  a  text  string  with  word  wrapping  to  the  current  port. 
outt(S  :  String) 

This  procedure  outputs  the  string  ‘‘S**,  which  Is  a  list  where  the 
members  are  separated  with  spaces,  to  the  current  port  and  enables 
text  wrapping  while  In  the  graphics  mode. 

OutT 


II  ^ia  procedure 


Show 


Function 

Declaration 

Remarks 

See  also 


Sets  the  position  und  slse  parameters  for  displaying  a  large 
pie  chart. 

ple(S  !  String) 

This  procedure  sets  the  position  and  radius  for  a  largo  pie  chart  and 
calls  drawple  to  draw  the  actual  chart. 

Drawpie,  Net 


Tit 


Kleii  Aincilon" 


Function 
Declaration 
Result  typo 
Remarks 

See  also 

Example 


Returns  the  specifled  list  with  the  first  member  deleted. 
rest(X) 

String 

This  function  operates  on  lists  where  the  members  are  delineated 
with  commas. 

RestT,  First,  FIrstT 
X  \m  a,s,d,f; 

S  i«  rest(X)i 

In  this  examplot  S  ■  s,dtf 


intiitrruriiirii - - - cim 

Function  Returns  the  specified  list  with  the  first  member  deleted. 


TO 


Declaration  re8tt(X  :  String) 

Revult  type  String 

Remarks  This  function  operates  on  lists  where  the  members  are  delineated 
with  blank  spaces. 

See  also  FlrstT 

Sxample  X  ;■  'the  node  is  not  active.,.*; 

S  m  restt(X); 

In  this  example,  S  m  *node  Is  not  active...* 


II  ReveritArc  procedure 


Show 


Funotlon  Reverses  an  arc's  orientation. 

Deelaratlon  reversearc(S :  String) 

Remarks  This  procedure  hides  the  specliled  arc,  reveries  its  parameters,  and 

shows  the  new  arc. 

See  also  HIdeArc,  ShowArc 


Savadata  procedure 


Parti 


Funeilon 

Deelaratlon 

Remarks 


See  also 


Writes  current  system  data  to  the  specified  filo. 

savedata 

This  procedure  writes  the  active  and  inactive  node  lists,  the  active 
arc  Hat,  the  node  Index,  the  nodes'  names  and  parents,  and  the  arcs* 
parameters  to  an  Indicated  (He. 

Loaddata 


SeiPori  procedure 


Ports 


Funotlon  Changes  the  active  graphics  port. 

Deoleretlon  eetport(l  t  Integer) 

Remarks  This  procedure  changes  the  active  viewport  to  the  specified  port.  It 
handles  all  the  administrative  overhead  Involved  with  switching  the 
acllvu  output  port 


|l|e{||ProHi^ 


dhow 


Funotlon  Normalliei  the  ‘'Prob*'  values  over  a  connected  graph. 
Declaration  ietprobs(S  t  String) 


lUmarki 
Sm  alio 


This  procedure  ii  used  in  conjunction  with  FigNet,  Sum,  and  Fig- 
Probs  to  update  the  probabllltlei  of  a  connected  graph. 

FigNet,  Sum,  FigProbi 


[|  ShowArc  procedure 


Function 

Doelaratton 

Ramarki 


See  alio 


Draws  the  ipeclfled  arc  In  the  color  of  the  head  node. 
ihowarc(S :  String) 

This  procedure  ensures  that  the  specified  arc  Is  connecting  two  nodes 
that  are  indeed  visible.  If  the  two  nodes  are  visible,  ShowArc  draws 
(by  calling  DrawArc)  the  arc  in  the  head  node’s  color  and  outputs 
the  ratio  to  port  4. 

DrawArc,  HldeArc 


II  shownienu  proceduM 


Menu  I 


Function  Outputs  the  ipeclfled  menu  options  to  the  menu  port  (2). 
Declaration  ihowmenu(S  i  String) 

Remarks  This  procedure  outputs  the  ipeclfled  menu  options  to  port  2.  "S"  is  a 
list  with  six  elements.  The  elements  represent  the  displayed  options 
for  a  particular  menu. 


Sum  hinctlon 


Function 
Declaration 
Result  type 
Remarks 

See  also 


Sums  the  *'Prob”  values  for  a  connected  graph. 
ium(S  I  String) 

Real 

This  procedure  is  used  In  normalising  the  “Prob”  values  of  a  con¬ 
nected  graph.  It  calculates  the  sum  of  the  ”Prob”  values. 

FlgProbi,  FigNet,  SetProbs 


"Trianguiaten^oceSure _ SFiow  || 

Function  Performs  the  ’’trlangulatlou”  function  of  probability  ratio 

graphs. 

Declaration  triangulate 

Remarks  This  procedure  prompts  for  the  node  between  which  to  triangulate. 

It  uses  FIttdPath  and  MakePath  and  presents  the  path  so  the  user 
can  choose  which  arc  to  replace. 
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See  also 


Cluster,  Triangulate 


Parts 


Which  funcilon 


Function 
Daelaration 
Result  type 
Remarks 


Example 


Returns  the  numerical  value  of  the  specified  index. 
whlch(S  :  String) 

Integer 

This  function  is  used  in  the  Identification  of  the  nodes  and  arcs.  The 
nodes  and  arcs  are  indexed  In  an  array  format  and  by  retrieving  the 
numerical  index  the  record  values  can  be  retrieved  and  manipulated. 

S  ‘N12’ 

T  !«  whlr.h(S) 

In  this  example,  T  «  12. 
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Incorporating  techniques  for  coping  with  uncertainty  in  the  decision  support  systems 
has  proven  to  be  a  fertile  environment  for  creative  ideas.  Representations  of  uncertainty 
abound  and  no  representation  can  be  said  to  be  inherently  incorrect.  From  a  thcorotical 
standpoint,  a  viable  solution  must  be  coherent  and  logically  consistent.  Probability  theory 
demonstrates  these  characteristics  while,  as  of  yet,  other  methods  do  not. 

The  purpose  of  this  study  was  to  investigate  specific  topics  in  uncertainty  reasoning; 
1)  Probability  mti'o  graphs  as  a  representation  of  the  probability  model;  2)  Dealing  with 
missing  information  when  system  parameters  are  left  unspecified;  3)  Investigating  the 
difference  between  probabilistic  and  causal  Independence;  and,  4)  Characterizing  secondary 
uncertainty  as  spurious  evidence  and  including  it  in  the  inference  process. 

It  was  shown  that  probability  ratio  graphs  are  a  viable  method  for  representing 
uncertainty,  and  a  method  for  representing  independence  with  probability  ratio  graphs  is 
presented.  Assuming  probabilistic  independence  for  missing  Information  is  shown  to  have 
intuitive  and  computational  benefits;  also  shown  is  that  where  secondary  uncertainty  is 
included  in  the  inference  process  has  great  Impact  on  the  computational  comple.'dty  of  an 
inference  process. 
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